[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:02 dist-test-slave-69rg krb5kdc[31021](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:02 dist-test-slave-69rg krb5kdc[31021](info): set up 2 sockets
Aug 11 07:02:02 dist-test-slave-69rg krb5kdc[31021](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 07:02:03.497038 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.006s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:03 dist-test-slave-69rg krb5kdc[31021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:03.720551 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44807
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44807
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:04.114949 31035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:04.115351 31035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:04.115521 31035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:04.123167 31035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:04.123334 31035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:04.123448 31035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:04.123558 31035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:04.123641 31035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:04.133597 31035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:04.135031 31035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:04.136430 31035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:04.150362 31040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:04.150305 31043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:04.150305 31041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:04.151021 31035 server_base.cc:1034] running on GCE node
I20260811 07:02:04.151932 31035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:04.153460 31035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:04.154728 31035 hybrid_clock.cc:648] HybridClock initialized: now 1786431724154668 us; error 51 us; skew 500 ppm
I20260811 07:02:04.155071 31035 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:04 dist-test-slave-69rg krb5kdc[31021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431724, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:04.158573 31035 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:04.160156 31035 webserver.cc:460] Webserver started at http://127.30.73.126:42333/ using document root <none> and password file <none>
I20260811 07:02:04.160842 31035 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:04.160948 31035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:04.161228 31035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:04.164489 31035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "8476eb1f3c4c4a91a12a36c438e10b09"
format_stamp: "Formatted at 2026-08-11 07:02:04 on dist-test-slave-69rg"
server_key: "d505980123ad744d68bdcc81f947549e"
server_key_iv: "a214e094b55f2f24aaf48840b388ad04"
server_key_version: "encryptionkey@0"
I20260811 07:02:04.165264 31035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "8476eb1f3c4c4a91a12a36c438e10b09"
format_stamp: "Formatted at 2026-08-11 07:02:04 on dist-test-slave-69rg"
server_key: "d505980123ad744d68bdcc81f947549e"
server_key_iv: "a214e094b55f2f24aaf48840b388ad04"
server_key_version: "encryptionkey@0"
I20260811 07:02:04.170863 31035 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260811 07:02:04.174654 31053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:04.176139 31035 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:02:04.176362 31035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "8476eb1f3c4c4a91a12a36c438e10b09"
format_stamp: "Formatted at 2026-08-11 07:02:04 on dist-test-slave-69rg"
server_key: "d505980123ad744d68bdcc81f947549e"
server_key_iv: "a214e094b55f2f24aaf48840b388ad04"
server_key_version: "encryptionkey@0"
I20260811 07:02:04.176573 31035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:04.193004 31035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:04.198144 31035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:04.198494 31035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:04.219511 31035 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:44807
I20260811 07:02:04.219547 31107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:44807 every 8 connection(s)
I20260811 07:02:04.221146 31035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:04.224927 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 31035
I20260811 07:02:04.225507 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:04.226101 31108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:04.228343 31013 external_mini_cluster.cc:1428] Setting key ff2fb22b09875e674297e6abd36d7eb4
I20260811 07:02:04.242581 31108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09: Bootstrap starting.
I20260811 07:02:04.246146 31108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:04.247501 31108 log.cc:824] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:04.252321 31108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09: No bootstrap required, opened a new log
I20260811 07:02:04.260062 31108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476eb1f3c4c4a91a12a36c438e10b09" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44807 } }
I20260811 07:02:04.260571 31108 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:04.260710 31108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8476eb1f3c4c4a91a12a36c438e10b09, State: Initialized, Role: FOLLOWER
I20260811 07:02:04.261556 31108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476eb1f3c4c4a91a12a36c438e10b09" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44807 } }
I20260811 07:02:04.261967 31108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:04.262200 31108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:04.262450 31108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 07:02:04 dist-test-slave-69rg krb5kdc[31021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:04.266016 31108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476eb1f3c4c4a91a12a36c438e10b09" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44807 } }
I20260811 07:02:04.266556 31108 leader_election.cc:302] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8476eb1f3c4c4a91a12a36c438e10b09; no voters:
I20260811 07:02:04.267282 31108 leader_election.cc:288] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:04.267418 31113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:04.268643 31113 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [term 1 LEADER]: Becoming Leader. State: Replica: 8476eb1f3c4c4a91a12a36c438e10b09, State: Running, Role: LEADER
I20260811 07:02:04.269310 31113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476eb1f3c4c4a91a12a36c438e10b09" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44807 } }
I20260811 07:02:04.269953 31108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:04.272529 31115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8476eb1f3c4c4a91a12a36c438e10b09. Latest consensus state: current_term: 1 leader_uuid: "8476eb1f3c4c4a91a12a36c438e10b09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476eb1f3c4c4a91a12a36c438e10b09" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44807 } } }
I20260811 07:02:04.273007 31115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:04.273758 31114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8476eb1f3c4c4a91a12a36c438e10b09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476eb1f3c4c4a91a12a36c438e10b09" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44807 } } }
I20260811 07:02:04.274142 31114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:04.281374 31110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:04.233711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56828 (local address 127.30.73.126:44807)
0811 07:02:04.235971 (+ 2260us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:04.236006 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:04.237742 (+ 1736us) server_negotiation.cc:407] Connection header received
0811 07:02:04.250468 (+ 12726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:04.250502 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:04.250997 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:04.251493 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:04.254889 (+ 3396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:04.256233 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:04.258024 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:04.258749 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:04.258983 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:04.267383 (+ 8400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:04.267397 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:04.267425 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:04.267482 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:04.271932 (+ 4450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:04.273158 (+ 1226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:04.273166 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:04.273173 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:04.273418 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:04.274158 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:04.274162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:04.274166 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:04.275118 (+ 952us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:04.279094 (+ 3976us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:04.279460 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 07:02:04.280008 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1817,"thread_start_us":1241,"threads_started":1}
I20260811 07:02:04.285724 31119 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:04.291232 31119 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:04.301163 31119 catalog_manager.cc:1347] Generated new cluster ID: 271bc6598f8e48c4a1d5863fef65f584
I20260811 07:02:04.301298 31119 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:04.319520 31119 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:04.321035 31119 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:04.334682 31119 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8476eb1f3c4c4a91a12a36c438e10b09: Generated new TSK 0
I20260811 07:02:04.335847 31119 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:02:04.399012 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44807
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:04.788861 31142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:04.789261 31142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:04.789450 31142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:04.797756 31142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:04.798032 31142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:04.798293 31142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:04.809718 31142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44807
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:04.811399 31142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:04.812860 31142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:04.828078 31147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:04.828181 31148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:04.828811 31150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:04.829368 31142 server_base.cc:1034] running on GCE node
I20260811 07:02:04.830641 31142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:04.832087 31142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:04.833444 31142 hybrid_clock.cc:648] HybridClock initialized: now 1786431724833369 us; error 43 us; skew 500 ppm
I20260811 07:02:04.833983 31142 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:04 dist-test-slave-69rg krb5kdc[31021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431724, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:04.837949 31142 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:02:04.839913 31142 webserver.cc:460] Webserver started at http://127.30.73.65:41843/ using document root <none> and password file <none>
I20260811 07:02:04.840680 31142 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:04.840799 31142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:04.841091 31142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:04.844399 31142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "1ac0d6deecc14dcabdb549c88d590581"
format_stamp: "Formatted at 2026-08-11 07:02:04 on dist-test-slave-69rg"
server_key: "347f65661c604454d20d785b5fef093f"
server_key_iv: "1c8f22b4da2469c9d20d7db48a78fab6"
server_key_version: "encryptionkey@0"
I20260811 07:02:04.845224 31142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "1ac0d6deecc14dcabdb549c88d590581"
format_stamp: "Formatted at 2026-08-11 07:02:04 on dist-test-slave-69rg"
server_key: "347f65661c604454d20d785b5fef093f"
server_key_iv: "1c8f22b4da2469c9d20d7db48a78fab6"
server_key_version: "encryptionkey@0"
I20260811 07:02:04.851073 31142 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 07:02:04.855010 31158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:04.856549 31142 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260811 07:02:04.856803 31142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "1ac0d6deecc14dcabdb549c88d590581"
format_stamp: "Formatted at 2026-08-11 07:02:04 on dist-test-slave-69rg"
server_key: "347f65661c604454d20d785b5fef093f"
server_key_iv: "1c8f22b4da2469c9d20d7db48a78fab6"
server_key_version: "encryptionkey@0"
I20260811 07:02:04.857033 31142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:04.870422 31142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:04.875464 31142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:04.875854 31142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:04.877002 31142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:04.878851 31142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:04.878942 31142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:04.879117 31142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:04.879191 31142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:04.921197 31142 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:44101
I20260811 07:02:04.921268 31285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:44101 every 8 connection(s)
I20260811 07:02:04.922724 31142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:04.923883 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 31142
I20260811 07:02:04.924144 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:04.924999 31013 external_mini_cluster.cc:1428] Setting key 1e554f4c364a6e7ef827527175c52315
Aug 11 07:02:04 dist-test-slave-69rg krb5kdc[31021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431724, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
I20260811 07:02:04.945870 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:04.925920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:41993 (local address 127.30.73.126:44807)
0811 07:02:04.926444 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:04.926451 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:04.927594 (+ 1143us) server_negotiation.cc:407] Connection header received
0811 07:02:04.929529 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:04.929536 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:04.929636 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:04.929763 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:04.931374 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:04.932118 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:04.934734 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:04.935170 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:04.935289 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:04.939678 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:04.939683 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:04.939687 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:04.939721 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:04.942604 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:04.943375 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:04.943385 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:04.943388 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:04.943515 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:04.943980 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:04.943987 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:04.943995 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:04.944311 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:04.944470 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:04.945243 (+ 773us) server_negotiation.cc:299] Negotiation successful
0811 07:02:04.945476 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":251,"threads_started":1}
I20260811 07:02:04.946846 31289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:04.926464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44807 (local address 127.30.73.65:41993)
0811 07:02:04.927436 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:04.927486 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:04.929228 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:04.930047 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:04.930055 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:04.930595 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:04.931184 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:04.931211 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:04.932298 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:04.932303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:04.934549 (+ 2246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:04.934574 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:04.935422 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:04.935431 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:04.935765 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:04.936558 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:04.936593 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:04.939426 (+ 2833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:04.942761 (+ 3335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:04.942771 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:04.942787 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:04.943237 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:04.943640 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:04.943646 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:04.943650 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:04.943852 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:04.944450 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:04.944458 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:04.944830 (+ 372us) client_negotiation.cc:769] Sending connection context
0811 07:02:04.945102 (+ 272us) client_negotiation.cc:240] Negotiation successful
0811 07:02:04.945670 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"thread_start_us":494,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
I20260811 07:02:04.948606 31286 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44807
I20260811 07:02:04.948941 31286 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:04.949661 31286 heartbeater.cc:511] Master 127.30.73.126:44807 requested a full tablet report, sending...
I20260811 07:02:04.952119 31071 ts_manager.cc:194] Registered new tserver with Master: 1ac0d6deecc14dcabdb549c88d590581 (127.30.73.65:44101)
I20260811 07:02:04.953639 31071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:41993
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:02:04.973939 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44807
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:05.331147 31292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:05.331461 31292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:05.331641 31292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:05.339933 31292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:05.340082 31292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:05.340269 31292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:05.351488 31292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44807
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:05.352957 31292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:05.354480 31292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:05.369714 31300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:05.369726 31297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:05.369972 31298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:05.370594 31292 server_base.cc:1034] running on GCE node
I20260811 07:02:05.371470 31292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:05.372542 31292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:05.373806 31292 hybrid_clock.cc:648] HybridClock initialized: now 1786431725373748 us; error 53 us; skew 500 ppm
I20260811 07:02:05.374224 31292 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:05 dist-test-slave-69rg krb5kdc[31021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431725, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:05.377748 31292 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:02:05.379577 31292 webserver.cc:460] Webserver started at http://127.30.73.66:43551/ using document root <none> and password file <none>
I20260811 07:02:05.380471 31292 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:05.380646 31292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:05.381021 31292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:05.384514 31292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "28887e34b8d14d9196f9f8a34ac8a038"
format_stamp: "Formatted at 2026-08-11 07:02:05 on dist-test-slave-69rg"
server_key: "a34cca439a2df50c4ad828a9f6463aba"
server_key_iv: "ed56ed411ef0e2c8d594c5f9e6b3ae6c"
server_key_version: "encryptionkey@0"
I20260811 07:02:05.385402 31292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "28887e34b8d14d9196f9f8a34ac8a038"
format_stamp: "Formatted at 2026-08-11 07:02:05 on dist-test-slave-69rg"
server_key: "a34cca439a2df50c4ad828a9f6463aba"
server_key_iv: "ed56ed411ef0e2c8d594c5f9e6b3ae6c"
server_key_version: "encryptionkey@0"
I20260811 07:02:05.391271 31292 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 07:02:05.395233 31308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:05.396605 31292 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 07:02:05.396798 31292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "28887e34b8d14d9196f9f8a34ac8a038"
format_stamp: "Formatted at 2026-08-11 07:02:05 on dist-test-slave-69rg"
server_key: "a34cca439a2df50c4ad828a9f6463aba"
server_key_iv: "ed56ed411ef0e2c8d594c5f9e6b3ae6c"
server_key_version: "encryptionkey@0"
I20260811 07:02:05.397023 31292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:05.416241 31292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:05.421025 31292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:05.421375 31292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:05.422560 31292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:05.424271 31292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:05.424414 31292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:05.424582 31292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:05.424660 31292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:05.462092 31292 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:36557
I20260811 07:02:05.462128 31431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:36557 every 8 connection(s)
I20260811 07:02:05.463510 31292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:05.464810 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 31292
I20260811 07:02:05.465022 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:05.465577 31013 external_mini_cluster.cc:1428] Setting key 8966e069b007df2660f20283dc6c1090
Aug 11 07:02:05 dist-test-slave-69rg krb5kdc[31021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431725, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
I20260811 07:02:05.487185 31434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:05.466625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:60289 (local address 127.30.73.126:44807)
0811 07:02:05.467132 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:05.467136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:05.468386 (+ 1250us) server_negotiation.cc:407] Connection header received
0811 07:02:05.470456 (+ 2070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:05.470464 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:05.470555 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:05.470674 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:05.472330 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:05.473520 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:05.475992 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:05.476439 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:05.476589 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:05.480365 (+ 3776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:05.480401 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:05.480406 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:05.480450 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:05.483450 (+ 3000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:05.484445 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:05.484456 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:05.484458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:05.484609 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:05.485112 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:05.485116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:05.485119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:05.485459 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:05.485636 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:05.486463 (+ 827us) server_negotiation.cc:299] Negotiation successful
0811 07:02:05.486730 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":229,"threads_started":1}
I20260811 07:02:05.488258 31435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:05.467291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44807 (local address 127.30.73.66:60289)
0811 07:02:05.468198 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:05.468265 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:05.470143 (+ 1878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:05.470884 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:05.470891 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:05.471524 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:05.472156 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:05.472174 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:05.473696 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:05.473700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:05.475836 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:05.475850 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:05.476698 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:05.476706 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:05.476952 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:05.477691 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:05.477714 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:05.480051 (+ 2337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:05.483615 (+ 3564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:05.483625 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:05.483758 (+ 133us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:05.484266 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:05.484742 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:05.484747 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:05.484751 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:05.484960 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:05.485608 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:05.485616 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:05.486059 (+ 443us) client_negotiation.cc:769] Sending connection context
0811 07:02:05.486382 (+ 323us) client_negotiation.cc:240] Negotiation successful
0811 07:02:05.487026 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":366,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
I20260811 07:02:05.489904 31432 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44807
I20260811 07:02:05.490283 31432 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:05.491279 31432 heartbeater.cc:511] Master 127.30.73.126:44807 requested a full tablet report, sending...
I20260811 07:02:05.493125 31071 ts_manager.cc:194] Registered new tserver with Master: 28887e34b8d14d9196f9f8a34ac8a038 (127.30.73.66:36557)
I20260811 07:02:05.494102 31071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:60289
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:02:05.513655 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44807
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:05.866372 31438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:05.866685 31438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:05.866808 31438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:05.877394 31438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:05.877574 31438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:05.877714 31438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:05.888873 31438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44807
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:05.890339 31438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:05.891769 31438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:05.907143 31445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:05.907352 31448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:05.907770 31446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:05.908720 31438 server_base.cc:1034] running on GCE node
I20260811 07:02:05.909484 31438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:05.910660 31438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:05.911937 31438 hybrid_clock.cc:648] HybridClock initialized: now 1786431725911868 us; error 68 us; skew 500 ppm
I20260811 07:02:05.912344 31438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:05 dist-test-slave-69rg krb5kdc[31021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431725, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:05.915915 31438 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:02:05.917465 31438 webserver.cc:460] Webserver started at http://127.30.73.67:38537/ using document root <none> and password file <none>
I20260811 07:02:05.918272 31438 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:05.918385 31438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:05.918670 31438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:05.921931 31438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "dd4d299aa2ca4e7dbbea2d8d4b435931"
format_stamp: "Formatted at 2026-08-11 07:02:05 on dist-test-slave-69rg"
server_key: "a25e2d57082fec9592c4b1c18df2e1f6"
server_key_iv: "a6e06fee0275ae187c6f678d68de7321"
server_key_version: "encryptionkey@0"
I20260811 07:02:05.922806 31438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "dd4d299aa2ca4e7dbbea2d8d4b435931"
format_stamp: "Formatted at 2026-08-11 07:02:05 on dist-test-slave-69rg"
server_key: "a25e2d57082fec9592c4b1c18df2e1f6"
server_key_iv: "a6e06fee0275ae187c6f678d68de7321"
server_key_version: "encryptionkey@0"
I20260811 07:02:05.928843 31438 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:02:05.932972 31455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:05.934505 31438 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:02:05.934721 31438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "dd4d299aa2ca4e7dbbea2d8d4b435931"
format_stamp: "Formatted at 2026-08-11 07:02:05 on dist-test-slave-69rg"
server_key: "a25e2d57082fec9592c4b1c18df2e1f6"
server_key_iv: "a6e06fee0275ae187c6f678d68de7321"
server_key_version: "encryptionkey@0"
I20260811 07:02:05.934969 31438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:05.952288 31438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:05.956699 31286 heartbeater.cc:503] Master 127.30.73.126:44807 was elected leader, sending a full tablet report...
I20260811 07:02:05.957695 31438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:05.958099 31438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:05.959380 31438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:05.960816 31438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:05.960892 31438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:05.961023 31438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:05.961097 31438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:05.997648 31438 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:34501
I20260811 07:02:05.997702 31586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:34501 every 8 connection(s)
I20260811 07:02:05.999010 31438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:06.004690 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 31438
I20260811 07:02:06.004932 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:06.005405 31013 external_mini_cluster.cc:1428] Setting key 8874077d2205c6bfb8ee9beba7d8cbdc
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431725, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:06.021677 31589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:06.001923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:39741 (local address 127.30.73.126:44807)
0811 07:02:06.002497 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:06.002501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:06.003263 (+ 762us) server_negotiation.cc:407] Connection header received
0811 07:02:06.005458 (+ 2195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:06.005464 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:06.005582 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:06.005722 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:06.007598 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.008616 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.010622 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.011037 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.011151 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:06.015202 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:06.015208 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:06.015212 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:06.015256 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:06.018240 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.019022 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.019026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.019028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.019159 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.019556 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.019559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.019561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.019852 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:06.019971 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:06.020965 (+ 994us) server_negotiation.cc:299] Negotiation successful
0811 07:02:06.021274 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":334,"threads_started":1}
I20260811 07:02:06.022861 31591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:06.002365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44807 (local address 127.30.73.67:39741)
0811 07:02:06.003087 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:06.003134 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:06.005130 (+ 1996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:06.006014 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:06.006022 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:06.006670 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:06.007420 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:06.007442 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.008870 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.008875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:06.010413 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:06.010429 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.011342 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.011348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:06.011574 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:06.012345 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:06.012376 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:06.014932 (+ 2556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:06.018396 (+ 3464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:06.018404 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:06.018418 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:06.018895 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:06.019255 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:06.019259 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:06.019261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:06.019448 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:06.020034 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:06.020043 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:06.020520 (+ 477us) client_negotiation.cc:769] Sending connection context
0811 07:02:06.020860 (+ 340us) client_negotiation.cc:240] Negotiation successful
0811 07:02:06.021441 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":291,"threads_started":1}
I20260811 07:02:06.024371 31587 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44807
I20260811 07:02:06.024727 31587 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:06.025498 31587 heartbeater.cc:511] Master 127.30.73.126:44807 requested a full tablet report, sending...
I20260811 07:02:06.026998 31071 ts_manager.cc:194] Registered new tserver with Master: dd4d299aa2ca4e7dbbea2d8d4b435931 (127.30.73.67:34501)
I20260811 07:02:06.027854 31071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:39741
I20260811 07:02:06.034972 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431726, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431726, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:06.096004 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:06.075009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46624 (local address 127.30.73.65:44101)
0811 07:02:06.078430 (+ 3421us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:06.078443 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:06.078475 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:02:06.078544 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:06.078551 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:06.078786 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:06.078936 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:06.080798 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.082094 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.083569 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.084226 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.084344 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:06.089323 (+ 4979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:06.089341 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:06.089359 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:06.089419 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:06.092699 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.093552 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.093560 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.093563 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.093731 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.094256 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.094260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.094262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.094709 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:06.094954 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:06.095338 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 07:02:06.095626 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3232,"thread_start_us":3075,"threads_started":1}
W20260811 07:02:06.097380 31189 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46624
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:06.148329 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:06.133428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46630 (local address 127.30.73.65:44101)
0811 07:02:06.133674 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:06.133682 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:06.134147 (+ 465us) server_negotiation.cc:407] Connection header received
0811 07:02:06.134388 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:06.134392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:06.134461 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:06.134568 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:06.136031 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.136720 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.138056 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.138499 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.138634 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:06.142966 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:06.142972 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:06.142975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:06.143014 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:06.145647 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.146362 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.146370 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.146378 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.146513 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.146906 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.146910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.146912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.147167 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:06.147431 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:06.147750 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 07:02:06.147983 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 07:02:06.149977 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 31142
I20260811 07:02:06.165334 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:06.151299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46632 (local address 127.30.73.65:44101)
0811 07:02:06.151630 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:06.151636 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:06.151750 (+ 114us) server_negotiation.cc:407] Connection header received
0811 07:02:06.151931 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:06.151935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:06.151997 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:06.152090 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:06.153766 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.154680 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.156077 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.156584 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.156721 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:06.159238 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:06.159244 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:06.159247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:06.159281 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:06.162546 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.163216 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.163221 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.163243 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.163386 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.163844 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.163856 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.163859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.164144 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:06.164413 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:06.164739 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 07:02:06.164963 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260811 07:02:06.166119 31281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:06.256055 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 31142
I20260811 07:02:06.277902 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 31292
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:02:06.296947 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:06.278944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33376 (local address 127.30.73.66:36557)
0811 07:02:06.279777 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:06.279788 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:06.280033 (+ 245us) server_negotiation.cc:407] Connection header received
0811 07:02:06.280124 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:06.280132 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:06.280417 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:06.280613 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:06.282102 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.283142 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.284494 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.285072 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.285220 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:06.290316 (+ 5096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:06.290331 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:06.290348 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:06.290393 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:06.293571 (+ 3178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.294476 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.294484 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.294487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.294642 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.295186 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.295195 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.295197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.295581 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:06.295915 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:06.296269 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 07:02:06.296564 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":292,"threads_started":1}
I20260811 07:02:06.298492 31427 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:06.384675 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 31292
I20260811 07:02:06.405349 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 31438
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:02:06.423008 31606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:06.406435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37642 (local address 127.30.73.67:34501)
0811 07:02:06.407053 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:06.407061 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:06.407090 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:02:06.407164 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:06.407171 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:06.407387 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:06.407560 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:06.408980 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.410180 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.411492 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:06.412097 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:06.412258 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:06.416839 (+ 4581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:06.416853 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:06.416869 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:06.416907 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:06.419928 (+ 3021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.420705 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.420713 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.420715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.420848 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:06.421258 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:06.421263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:06.421266 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:06.421650 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:06.422119 (+ 469us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:06.422332 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 07:02:06.422641 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":289,"threads_started":1}
I20260811 07:02:06.424338 31582 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:06.528664 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 31438
I20260811 07:02:06.551314 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 31035
I20260811 07:02:06.552621 31103 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:06.659368 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 31035
2026-08-11T07:02:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4419 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31611](info): set up 2 sockets
Aug 11 07:02:06 dist-test-slave-69rg krb5kdc[31611](info): commencing operation
krb5kdc: starting...
W20260811 07:02:07.866360 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:08 dist-test-slave-69rg krb5kdc[31611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:08.107702 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44771
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44771
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:08.465505 31627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:08.465938 31627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:08.466112 31627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:08.473762 31627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:08.473961 31627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:08.474051 31627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:08.474167 31627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:08.474255 31627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:08.488808 31627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:08.490386 31627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:08.491813 31627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:08.503968 31632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:08.504101 31633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:08.504139 31636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:08.505267 31627 server_base.cc:1034] running on GCE node
I20260811 07:02:08.506275 31627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:08.507735 31627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:08.509007 31627 hybrid_clock.cc:648] HybridClock initialized: now 1786431728508941 us; error 41 us; skew 500 ppm
I20260811 07:02:08.509442 31627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:08 dist-test-slave-69rg krb5kdc[31611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431728, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:08.517956 31627 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:08.519979 31627 webserver.cc:460] Webserver started at http://127.30.73.126:38179/ using document root <none> and password file <none>
I20260811 07:02:08.520762 31627 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:08.520924 31627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:08.521288 31627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:08.525099 31627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "bfbae1b050a84fb49e985df27b670809"
format_stamp: "Formatted at 2026-08-11 07:02:08 on dist-test-slave-69rg"
server_key: "702c67f6a13797045db43a954e265ff6"
server_key_iv: "d0456ca212944636d331ccfc09918779"
server_key_version: "encryptionkey@0"
I20260811 07:02:08.526058 31627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "bfbae1b050a84fb49e985df27b670809"
format_stamp: "Formatted at 2026-08-11 07:02:08 on dist-test-slave-69rg"
server_key: "702c67f6a13797045db43a954e265ff6"
server_key_iv: "d0456ca212944636d331ccfc09918779"
server_key_version: "encryptionkey@0"
I20260811 07:02:08.531817 31627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:08.536095 31644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:08.537757 31627 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:02:08.538142 31627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "bfbae1b050a84fb49e985df27b670809"
format_stamp: "Formatted at 2026-08-11 07:02:08 on dist-test-slave-69rg"
server_key: "702c67f6a13797045db43a954e265ff6"
server_key_iv: "d0456ca212944636d331ccfc09918779"
server_key_version: "encryptionkey@0"
I20260811 07:02:08.538414 31627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:08.572785 31627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:08.577904 31627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:08.578266 31627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:08.602309 31627 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:44771
I20260811 07:02:08.602362 31701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:44771 every 8 connection(s)
I20260811 07:02:08.603835 31627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:08.608740 31702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:08.610986 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 31627
I20260811 07:02:08.611356 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:08.612084 31013 external_mini_cluster.cc:1428] Setting key 5a064ddc8b1dbd2e779e10bf640c75dc
I20260811 07:02:08.623080 31702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809: Bootstrap starting.
I20260811 07:02:08.627244 31702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:08.628333 31702 log.cc:824] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:02:08 dist-test-slave-69rg krb5kdc[31611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:08.631850 31702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809: No bootstrap required, opened a new log
I20260811 07:02:08.643039 31705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:08.614515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56632 (local address 127.30.73.126:44771)
0811 07:02:08.615614 (+ 1099us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:08.615630 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:08.615684 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:02:08.618152 (+ 2468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:08.618184 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:08.618694 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:08.619181 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:08.620677 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:08.622736 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:08.624619 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:08.625793 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:08.626012 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:08.630960 (+ 4948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:08.630970 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:08.630986 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:08.631033 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:08.635658 (+ 4625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:08.636934 (+ 1276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:08.636947 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:08.636970 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:08.637507 (+ 537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:08.638577 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:08.638581 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:08.638584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:08.639403 (+ 819us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:08.639689 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:08.640879 (+ 1190us) server_negotiation.cc:299] Negotiation successful
0811 07:02:08.641319 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":849,"thread_start_us":362,"threads_started":1}
I20260811 07:02:08.644024 31702 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfbae1b050a84fb49e985df27b670809" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44771 } }
I20260811 07:02:08.644501 31702 raft_consensus.cc:374] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:08.644660 31702 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfbae1b050a84fb49e985df27b670809, State: Initialized, Role: FOLLOWER
I20260811 07:02:08.645428 31702 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfbae1b050a84fb49e985df27b670809" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44771 } }
I20260811 07:02:08.645767 31702 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:08.645929 31702 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:08.646121 31702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:08.648814 31702 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfbae1b050a84fb49e985df27b670809" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44771 } }
I20260811 07:02:08.649318 31702 leader_election.cc:302] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfbae1b050a84fb49e985df27b670809; no voters:
I20260811 07:02:08.650084 31702 leader_election.cc:288] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:08.650254 31707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:08.651127 31707 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [term 1 LEADER]: Becoming Leader. State: Replica: bfbae1b050a84fb49e985df27b670809, State: Running, Role: LEADER
I20260811 07:02:08.651697 31707 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfbae1b050a84fb49e985df27b670809" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44771 } }
I20260811 07:02:08.652448 31702 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:08.655143 31710 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfbae1b050a84fb49e985df27b670809. Latest consensus state: current_term: 1 leader_uuid: "bfbae1b050a84fb49e985df27b670809" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfbae1b050a84fb49e985df27b670809" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44771 } } }
I20260811 07:02:08.655530 31710 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:08.656692 31714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:08.656809 31708 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bfbae1b050a84fb49e985df27b670809" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfbae1b050a84fb49e985df27b670809" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44771 } } }
I20260811 07:02:08.657127 31708 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:08.664449 31714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:08.674978 31714 catalog_manager.cc:1347] Generated new cluster ID: f0ff48a4cf574625b163d9c3809494af
I20260811 07:02:08.675122 31714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:08.720408 31714 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:08.722886 31714 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:08.733743 31714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bfbae1b050a84fb49e985df27b670809: Generated new TSK 0
I20260811 07:02:08.734735 31714 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:02:08.809108 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44771
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:09.211366 31730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:09.211700 31730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:09.211881 31730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:09.219336 31730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:09.219498 31730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:09.219693 31730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:09.229993 31730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44771
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:09.231392 31730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:09.232889 31730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:09.249069 31737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:09.249516 31736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:09.249148 31739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:09.255332 31730 server_base.cc:1034] running on GCE node
I20260811 07:02:09.256035 31730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:09.257107 31730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:09.258358 31730 hybrid_clock.cc:648] HybridClock initialized: now 1786431729258304 us; error 40 us; skew 500 ppm
I20260811 07:02:09.258736 31730 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:09 dist-test-slave-69rg krb5kdc[31611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431729, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:09.262627 31730 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:02:09.264827 31730 webserver.cc:460] Webserver started at http://127.30.73.65:42995/ using document root <none> and password file <none>
I20260811 07:02:09.265599 31730 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:09.265712 31730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:09.266064 31730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:09.269101 31730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "0848d467793e47988abfd867f8b9cf8e"
format_stamp: "Formatted at 2026-08-11 07:02:09 on dist-test-slave-69rg"
server_key: "126373ea1bb259164e780faa3b70b21d"
server_key_iv: "7af03a027ce4722d32146a810f0b4992"
server_key_version: "encryptionkey@0"
I20260811 07:02:09.269956 31730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "0848d467793e47988abfd867f8b9cf8e"
format_stamp: "Formatted at 2026-08-11 07:02:09 on dist-test-slave-69rg"
server_key: "126373ea1bb259164e780faa3b70b21d"
server_key_iv: "7af03a027ce4722d32146a810f0b4992"
server_key_version: "encryptionkey@0"
I20260811 07:02:09.275990 31730 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:02:09.279948 31748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:09.281616 31730 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:02:09.281909 31730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "0848d467793e47988abfd867f8b9cf8e"
format_stamp: "Formatted at 2026-08-11 07:02:09 on dist-test-slave-69rg"
server_key: "126373ea1bb259164e780faa3b70b21d"
server_key_iv: "7af03a027ce4722d32146a810f0b4992"
server_key_version: "encryptionkey@0"
I20260811 07:02:09.282255 31730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:09.307171 31730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:09.311919 31730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:09.312268 31730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:09.313370 31730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:09.314846 31730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:09.314961 31730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:09.315124 31730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:09.315207 31730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:09.372630 31730 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:43945
I20260811 07:02:09.372643 31876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:43945 every 8 connection(s)
I20260811 07:02:09.374356 31730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:09.378782 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 31730
I20260811 07:02:09.379065 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:09.379805 31013 external_mini_cluster.cc:1428] Setting key 384959c03198733c64522580115a9837
Aug 11 07:02:09 dist-test-slave-69rg krb5kdc[31611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431729, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:09.405012 31879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:09.378229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:37775 (local address 127.30.73.126:44771)
0811 07:02:09.379222 (+ 993us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:09.379229 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:09.380751 (+ 1522us) server_negotiation.cc:407] Connection header received
0811 07:02:09.383011 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:09.383024 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:09.383153 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:09.383367 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:09.386390 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:09.388571 (+ 2181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:09.390728 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:09.391830 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:09.392139 (+ 309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:09.397233 (+ 5094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:09.397239 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:09.397243 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:09.397285 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:09.401041 (+ 3756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:09.402274 (+ 1233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:09.402280 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:09.402282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:09.402502 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:09.403011 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:09.403017 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:09.403020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:09.403366 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:09.403537 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:09.404352 (+ 815us) server_negotiation.cc:299] Negotiation successful
0811 07:02:09.404606 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":432,"threads_started":1}
I20260811 07:02:09.406189 31880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:09.379397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44771 (local address 127.30.73.65:37775)
0811 07:02:09.380322 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:09.380373 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:09.382502 (+ 2129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:09.383817 (+ 1315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:09.383830 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:09.384579 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:09.385626 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:09.385652 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:09.388845 (+ 3193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:09.388850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:09.390535 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:09.390553 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:09.392365 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:09.392373 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:09.392866 (+ 493us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:09.393797 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:09.393918 (+ 121us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:09.396907 (+ 2989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:09.401445 (+ 4538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:09.401456 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:09.401482 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:09.402105 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:09.402647 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:09.402654 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:09.402661 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:09.402877 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:09.403510 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:09.403519 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:09.403924 (+ 405us) client_negotiation.cc:769] Sending connection context
0811 07:02:09.404224 (+ 300us) client_negotiation.cc:240] Negotiation successful
0811 07:02:09.404825 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":382,"threads_started":1}
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
I20260811 07:02:09.408237 31877 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44771
I20260811 07:02:09.408562 31877 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:09.409350 31877 heartbeater.cc:511] Master 127.30.73.126:44771 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
I20260811 07:02:09.412200 31664 ts_manager.cc:194] Registered new tserver with Master: 0848d467793e47988abfd867f8b9cf8e (127.30.73.65:43945)
I20260811 07:02:09.414439 31664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:37775
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:02:09.451036 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44771
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:09.826356 31883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:09.826668 31883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:09.826840 31883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:09.835009 31883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:09.835184 31883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:09.835392 31883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:09.846500 31883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44771
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:09.847927 31883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:09.849370 31883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:09.863546 31888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:09.863569 31889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:09.863515 31891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:09.864830 31883 server_base.cc:1034] running on GCE node
I20260811 07:02:09.865451 31883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:09.866488 31883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:09.867703 31883 hybrid_clock.cc:648] HybridClock initialized: now 1786431729867656 us; error 35 us; skew 500 ppm
I20260811 07:02:09.868057 31883 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:09 dist-test-slave-69rg krb5kdc[31611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431729, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:09.871714 31883 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:02:09.873386 31883 webserver.cc:460] Webserver started at http://127.30.73.66:33107/ using document root <none> and password file <none>
I20260811 07:02:09.874187 31883 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:09.874342 31883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:09.874675 31883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:09.877743 31883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "4072597c58614ffd85d9ae2689175fbb"
format_stamp: "Formatted at 2026-08-11 07:02:09 on dist-test-slave-69rg"
server_key: "0b3e43573ad16f60629862e980ccec7a"
server_key_iv: "4fd64c76711372015f962e74732d3f7d"
server_key_version: "encryptionkey@0"
I20260811 07:02:09.878710 31883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "4072597c58614ffd85d9ae2689175fbb"
format_stamp: "Formatted at 2026-08-11 07:02:09 on dist-test-slave-69rg"
server_key: "0b3e43573ad16f60629862e980ccec7a"
server_key_iv: "4fd64c76711372015f962e74732d3f7d"
server_key_version: "encryptionkey@0"
I20260811 07:02:09.884006 31883 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:09.887866 31898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:09.889247 31883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:02:09.889420 31883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "4072597c58614ffd85d9ae2689175fbb"
format_stamp: "Formatted at 2026-08-11 07:02:09 on dist-test-slave-69rg"
server_key: "0b3e43573ad16f60629862e980ccec7a"
server_key_iv: "4fd64c76711372015f962e74732d3f7d"
server_key_version: "encryptionkey@0"
I20260811 07:02:09.889635 31883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:09.902021 31883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:09.906682 31883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:09.906981 31883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:09.907977 31883 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:09.909358 31883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:09.909462 31883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:09.909602 31883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:09.909682 31883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:09.948679 31883 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:36519
I20260811 07:02:09.948777 32022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:36519 every 8 connection(s)
I20260811 07:02:09.950171 31883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:09.957227 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 31883
I20260811 07:02:09.957453 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:09.957999 31013 external_mini_cluster.cc:1428] Setting key 2114697d10fb454a48b248c3aae6c650
Aug 11 07:02:09 dist-test-slave-69rg krb5kdc[31611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431729, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:09.973090 32025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:09.953025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:49737 (local address 127.30.73.126:44771)
0811 07:02:09.953539 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:09.953546 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:09.954600 (+ 1054us) server_negotiation.cc:407] Connection header received
0811 07:02:09.956456 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:09.956461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:09.956539 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:09.956653 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:09.958564 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:09.959540 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:09.961329 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:09.961887 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:09.962021 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:09.966176 (+ 4155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:09.966186 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:09.966192 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:09.966244 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:09.969134 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:09.970279 (+ 1145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:09.970284 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:09.970287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:09.970416 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:09.971046 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:09.971050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:09.971052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:09.971394 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:09.971530 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:09.972606 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0811 07:02:09.972796 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":270,"threads_started":1}
I20260811 07:02:09.974918 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:09.953603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44771 (local address 127.30.73.66:49737)
0811 07:02:09.954432 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:09.954480 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:09.956167 (+ 1687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:09.956927 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:09.956936 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:09.957607 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:09.958373 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:09.958393 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:09.959712 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:09.959717 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:09.961154 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:09.961173 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:09.962133 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:09.962141 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:09.962375 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:09.963214 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:09.963237 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:09.965906 (+ 2669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:09.969295 (+ 3389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:09.969317 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:09.969339 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:09.970123 (+ 784us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:09.970545 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:09.970554 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:09.970561 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:09.970881 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:09.971540 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:09.971552 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:09.972106 (+ 554us) client_negotiation.cc:769] Sending connection context
0811 07:02:09.972481 (+ 375us) client_negotiation.cc:240] Negotiation successful
0811 07:02:09.973151 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":356,"threads_started":1}
I20260811 07:02:09.976634 32023 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44771
I20260811 07:02:09.977005 32023 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:09.977799 32023 heartbeater.cc:511] Master 127.30.73.126:44771 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
I20260811 07:02:09.979560 31664 ts_manager.cc:194] Registered new tserver with Master: 4072597c58614ffd85d9ae2689175fbb (127.30.73.66:36519)
I20260811 07:02:09.980417 31664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:49737
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:02:10.011783 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44771
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:10.372418 32029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:10.372699 32029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:10.372859 32029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:10.380565 32029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:10.380717 32029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:10.380904 32029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:10.392124 32029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44771
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:10.393679 32029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:10.395239 32029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:10.410346 32039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:10.410460 32036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:10.410545 32037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:10.411369 32029 server_base.cc:1034] running on GCE node
I20260811 07:02:10.412020 32029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:10.413136 32029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:10.414394 32029 hybrid_clock.cc:648] HybridClock initialized: now 1786431730414331 us; error 50 us; skew 500 ppm
I20260811 07:02:10.414992 32029 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:10 dist-test-slave-69rg krb5kdc[31611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431730, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:10.418592 32029 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:02:10.419752 31877 heartbeater.cc:503] Master 127.30.73.126:44771 was elected leader, sending a full tablet report...
I20260811 07:02:10.420866 32029 webserver.cc:460] Webserver started at http://127.30.73.67:33801/ using document root <none> and password file <none>
I20260811 07:02:10.421926 32029 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:10.422087 32029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:10.422513 32029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:10.425734 32029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "8f90d25e25b74605babf3e16c640a178"
format_stamp: "Formatted at 2026-08-11 07:02:10 on dist-test-slave-69rg"
server_key: "24acec0faa71be94fc003ea1e2828dbc"
server_key_iv: "ff38bd37a997c01dc19d338f1a9fa1a6"
server_key_version: "encryptionkey@0"
I20260811 07:02:10.426698 32029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "8f90d25e25b74605babf3e16c640a178"
format_stamp: "Formatted at 2026-08-11 07:02:10 on dist-test-slave-69rg"
server_key: "24acec0faa71be94fc003ea1e2828dbc"
server_key_iv: "ff38bd37a997c01dc19d338f1a9fa1a6"
server_key_version: "encryptionkey@0"
I20260811 07:02:10.432500 32029 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:10.436828 32046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:10.438419 32029 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:02:10.438618 32029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "8f90d25e25b74605babf3e16c640a178"
format_stamp: "Formatted at 2026-08-11 07:02:10 on dist-test-slave-69rg"
server_key: "24acec0faa71be94fc003ea1e2828dbc"
server_key_iv: "ff38bd37a997c01dc19d338f1a9fa1a6"
server_key_version: "encryptionkey@0"
I20260811 07:02:10.439019 32029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:10.473173 32029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:10.477890 32029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:10.478221 32029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:10.479266 32029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:10.480734 32029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:10.480840 32029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:10.480995 32029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:10.481069 32029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:10.517671 32029 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:46419
I20260811 07:02:10.517783 32175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:46419 every 8 connection(s)
I20260811 07:02:10.519132 32029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:10.525053 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 32029
I20260811 07:02:10.525295 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:10.525911 31013 external_mini_cluster.cc:1428] Setting key 0e86c625805b94bed62a148bc8a8a796
Aug 11 07:02:10 dist-test-slave-69rg krb5kdc[31611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431730, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:10.546396 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.522050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:60655 (local address 127.30.73.126:44771)
0811 07:02:10.522533 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.522538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.523564 (+ 1026us) server_negotiation.cc:407] Connection header received
0811 07:02:10.526343 (+ 2779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.526348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.526421 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.526528 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:10.528413 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.529587 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.532935 (+ 3348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.533460 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.533589 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.538542 (+ 4953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:10.538548 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:10.538552 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:10.538592 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:10.542372 (+ 3780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.543464 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.543474 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.543478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.543697 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.544418 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.544422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.544425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.544718 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:10.544917 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.545708 (+ 791us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.545994 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":270,"threads_started":1}
I20260811 07:02:10.547422 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.522564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44771 (local address 127.30.73.67:60655)
0811 07:02:10.523387 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:10.523435 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:10.525960 (+ 2525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:10.526808 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:10.526817 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:10.527398 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:10.528241 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.528262 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.529766 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.529770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.532665 (+ 2895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.532684 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.534052 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.534064 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.534376 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.535390 (+ 1014us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:10.535424 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:10.538273 (+ 2849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:10.542562 (+ 4289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:10.542576 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:10.542600 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:10.543267 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:10.543849 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:10.543855 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:10.543873 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:10.544223 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:10.544886 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:10.544895 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:10.545297 (+ 402us) client_negotiation.cc:769] Sending connection context
0811 07:02:10.545590 (+ 293us) client_negotiation.cc:240] Negotiation successful
0811 07:02:10.546209 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":328,"threads_started":1}
I20260811 07:02:10.549175 32176 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44771
I20260811 07:02:10.549477 32176 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:10.550360 32176 heartbeater.cc:511] Master 127.30.73.126:44771 requested a full tablet report, sending...
I20260811 07:02:10.551961 31664 ts_manager.cc:194] Registered new tserver with Master: 8f90d25e25b74605babf3e16c640a178 (127.30.73.67:46419)
I20260811 07:02:10.553028 31664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:60655
I20260811 07:02:10.555416 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:02:10.578748 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.562870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56348 (local address 127.30.73.126:44771)
0811 07:02:10.563108 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.563114 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.563699 (+ 585us) server_negotiation.cc:407] Connection header received
0811 07:02:10.563844 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.563849 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.563957 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.564058 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:10.565772 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.566805 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.568281 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.568769 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.568908 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.572019 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:10.572026 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:10.572030 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:10.572074 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:10.575179 (+ 3105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.576029 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.576034 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.576036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.576182 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.576687 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.576691 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.576694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.577112 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:10.577379 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.578054 (+ 675us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.578354 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:02:10.587111 31664 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:02:10.596705 31664 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:10.636713 32190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.612323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:36519 (local address 127.0.0.1:44202)
0811 07:02:10.613164 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:10.613218 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:10.613468 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:10.628899 (+ 15431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:10.628913 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:10.628957 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:10.629450 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.629464 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.631658 (+ 2194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.631663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.633943 (+ 2280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.633958 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.635430 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.635437 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.635743 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.635823 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 07:02:10.635983 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 07:02:10.636209 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"mutex_wait_us":156,"thread_start_us":913,"threads_started":1}
I20260811 07:02:10.637156 32191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.612369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44202 (local address 127.30.73.66:36519)
0811 07:02:10.628012 (+ 15643us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.628022 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.628063 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:02:10.628205 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.628217 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.628561 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.629658 (+ 1097us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:10.629953 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.631516 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.634116 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.635132 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.635313 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.635554 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.636038 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.636434 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15469,"thread_start_us":15333,"threads_started":1}
I20260811 07:02:10.639169 32192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.615500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:46419 (local address 127.0.0.1:45284)
0811 07:02:10.629173 (+ 13673us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:10.629193 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:10.629336 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:10.630219 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:10.630224 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:10.630249 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:10.630729 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.630746 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.632904 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.632910 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.635794 (+ 2884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.635811 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.638181 (+ 2370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.638188 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.638376 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.638420 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 07:02:10.638521 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:02:10.638684 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13537,"mutex_wait_us":212,"thread_start_us":12610,"threads_started":1}
I20260811 07:02:10.639400 32196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.615852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45284 (local address 127.30.73.67:46419)
0811 07:02:10.627505 (+ 11653us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.627521 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.629492 (+ 1971us) server_negotiation.cc:407] Connection header received
0811 07:02:10.629613 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.629621 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.629890 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.630110 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:10.630954 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.632709 (+ 1755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.635999 (+ 3290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.637578 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.637715 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.638009 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.638796 (+ 787us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.638983 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11436,"thread_start_us":11259,"threads_started":1}
I20260811 07:02:10.639670 32195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.614093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:43945 (local address 127.0.0.1:53768)
0811 07:02:10.628418 (+ 14325us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:10.628445 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:10.628601 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:10.630494 (+ 1893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:10.630503 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:10.630530 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:10.631000 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.631012 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.632986 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.632990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.635803 (+ 2813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.635812 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.638488 (+ 2676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.638495 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.638704 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.638738 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:02:10.638844 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 07:02:10.638986 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14183,"mutex_wait_us":138,"thread_start_us":15723,"threads_started":1}
I20260811 07:02:10.639832 32194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.614550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53768 (local address 127.30.73.65:43945)
0811 07:02:10.629804 (+ 15254us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.629841 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.629870 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:02:10.629973 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.629983 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.630263 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.630480 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:10.631176 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.632820 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.635980 (+ 3160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.638245 (+ 2265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.638415 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.638640 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.639298 (+ 658us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.639487 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15057,"thread_start_us":15405,"threads_started":1}
I20260811 07:02:10.641916 31951 tablet_service.cc:1467] Processing CreateTablet for tablet c7a9fb2937544823bc1cd3eba848d8be (DEFAULT_TABLE table=test-table [id=0f0608d88e83421ebd5a9bc30369a28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:10.643927 31951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7a9fb2937544823bc1cd3eba848d8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:10.643869 31800 tablet_service.cc:1467] Processing CreateTablet for tablet c7a9fb2937544823bc1cd3eba848d8be (DEFAULT_TABLE table=test-table [id=0f0608d88e83421ebd5a9bc30369a28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:10.643365 32099 tablet_service.cc:1467] Processing CreateTablet for tablet c7a9fb2937544823bc1cd3eba848d8be (DEFAULT_TABLE table=test-table [id=0f0608d88e83421ebd5a9bc30369a28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:10.645169 31800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7a9fb2937544823bc1cd3eba848d8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:10.645313 32099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7a9fb2937544823bc1cd3eba848d8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:10.658979 32197 tablet_bootstrap.cc:492] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e: Bootstrap starting.
I20260811 07:02:10.662921 32198 tablet_bootstrap.cc:492] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb: Bootstrap starting.
I20260811 07:02:10.664081 32197 tablet_bootstrap.cc:654] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:10.665645 32197 log.cc:824] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:10.667130 32198 tablet_bootstrap.cc:654] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:10.667912 32199 tablet_bootstrap.cc:492] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178: Bootstrap starting.
I20260811 07:02:10.668633 32198 log.cc:824] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:10.669723 32197 tablet_bootstrap.cc:492] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e: No bootstrap required, opened a new log
I20260811 07:02:10.670051 32197 ts_tablet_manager.cc:1397] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260811 07:02:10.672658 32199 tablet_bootstrap.cc:654] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:10.674055 32199 log.cc:824] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:10.675823 32198 tablet_bootstrap.cc:492] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb: No bootstrap required, opened a new log
I20260811 07:02:10.676141 32198 ts_tablet_manager.cc:1397] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260811 07:02:10.677512 32199 tablet_bootstrap.cc:492] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178: No bootstrap required, opened a new log
I20260811 07:02:10.677853 32199 ts_tablet_manager.cc:1397] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260811 07:02:10.679299 32197 raft_consensus.cc:348] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } }
I20260811 07:02:10.679680 32197 raft_consensus.cc:374] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:10.679817 32197 raft_consensus.cc:729] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0848d467793e47988abfd867f8b9cf8e, State: Initialized, Role: FOLLOWER
I20260811 07:02:10.680475 32197 consensus_queue.cc:260] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } }
I20260811 07:02:10.685310 32197 ts_tablet_manager.cc:1428] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e: Time spent starting tablet: real 0.015s user 0.012s sys 0.000s
I20260811 07:02:10.687386 32198 raft_consensus.cc:348] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } }
I20260811 07:02:10.687911 32198 raft_consensus.cc:374] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:10.688019 32198 raft_consensus.cc:729] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4072597c58614ffd85d9ae2689175fbb, State: Initialized, Role: FOLLOWER
I20260811 07:02:10.688699 32198 consensus_queue.cc:260] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } }
I20260811 07:02:10.688831 32199 raft_consensus.cc:348] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } }
I20260811 07:02:10.689296 32199 raft_consensus.cc:374] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:10.689425 32199 raft_consensus.cc:729] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f90d25e25b74605babf3e16c640a178, State: Initialized, Role: FOLLOWER
I20260811 07:02:10.690023 32023 heartbeater.cc:503] Master 127.30.73.126:44771 was elected leader, sending a full tablet report...
I20260811 07:02:10.690089 32199 consensus_queue.cc:260] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } }
I20260811 07:02:10.690821 32198 ts_tablet_manager.cc:1428] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb: Time spent starting tablet: real 0.015s user 0.012s sys 0.005s
I20260811 07:02:10.691835 32176 heartbeater.cc:503] Master 127.30.73.126:44771 was elected leader, sending a full tablet report...
I20260811 07:02:10.692651 32199 ts_tablet_manager.cc:1428] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178: Time spent starting tablet: real 0.015s user 0.012s sys 0.002s
I20260811 07:02:10.699345 32207 raft_consensus.cc:482] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:10.699659 32207 raft_consensus.cc:504] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } }
I20260811 07:02:10.701332 32207 leader_election.cc:288] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4072597c58614ffd85d9ae2689175fbb (127.30.73.66:36519), 0848d467793e47988abfd867f8b9cf8e (127.30.73.65:43945)
W20260811 07:02:10.702514 32024 tablet.cc:2369] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:02:10.708163 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.701775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:36519 (local address 127.30.73.67:42379)
0811 07:02:10.702015 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:10.702034 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:10.702171 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:10.702795 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:10.702803 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:10.702841 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:10.703104 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.703117 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.704213 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.704220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.705896 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.705912 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.707273 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.707278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.707553 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.707590 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:02:10.707717 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 07:02:10.707871 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260811 07:02:10.708168 32191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.701782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:42379 (local address 127.30.73.66:36519)
0811 07:02:10.702054 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.702060 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.702085 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:02:10.702372 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.702377 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.702475 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.702570 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:10.703276 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.704080 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.706071 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.707114 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.707270 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.707351 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.707758 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.707900 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260811 07:02:10.709153 32194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.702458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:59541 (local address 127.30.73.65:43945)
0811 07:02:10.702672 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.702677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.703403 (+ 726us) server_negotiation.cc:407] Connection header received
0811 07:02:10.703589 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.703593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.703661 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.703757 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:10.704329 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.705025 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.707059 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.708249 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.708428 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.708519 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.708854 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.708974 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:02:10.709313 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.702267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:43945 (local address 127.30.73.67:59541)
0811 07:02:10.703310 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:10.703324 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:10.703452 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:10.703774 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:10.703778 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:10.703802 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:10.704133 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.704162 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.705200 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.705206 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.706857 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:10.706874 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.708506 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.708512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:10.708664 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.708690 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 07:02:10.708806 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 07:02:10.708959 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":914,"thread_start_us":666,"threads_started":1}
I20260811 07:02:10.709353 31971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7a9fb2937544823bc1cd3eba848d8be" candidate_uuid: "8f90d25e25b74605babf3e16c640a178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4072597c58614ffd85d9ae2689175fbb" is_pre_election: true
I20260811 07:02:10.710011 31971 raft_consensus.cc:2454] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f90d25e25b74605babf3e16c640a178 in term 0.
I20260811 07:02:10.710345 31824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7a9fb2937544823bc1cd3eba848d8be" candidate_uuid: "8f90d25e25b74605babf3e16c640a178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0848d467793e47988abfd867f8b9cf8e" is_pre_election: true
I20260811 07:02:10.710731 32052 leader_election.cc:302] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4072597c58614ffd85d9ae2689175fbb, 8f90d25e25b74605babf3e16c640a178; no voters:
I20260811 07:02:10.710923 31824 raft_consensus.cc:2454] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f90d25e25b74605babf3e16c640a178 in term 0.
I20260811 07:02:10.711141 32207 raft_consensus.cc:2781] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:10.711292 32207 raft_consensus.cc:482] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:10.711406 32207 raft_consensus.cc:3037] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:10.713761 32207 raft_consensus.cc:504] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } }
I20260811 07:02:10.714496 32207 leader_election.cc:288] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [CANDIDATE]: Term 1 election: Requested vote from peers 4072597c58614ffd85d9ae2689175fbb (127.30.73.66:36519), 0848d467793e47988abfd867f8b9cf8e (127.30.73.65:43945)
I20260811 07:02:10.715036 31971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7a9fb2937544823bc1cd3eba848d8be" candidate_uuid: "8f90d25e25b74605babf3e16c640a178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4072597c58614ffd85d9ae2689175fbb"
I20260811 07:02:10.715128 31824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7a9fb2937544823bc1cd3eba848d8be" candidate_uuid: "8f90d25e25b74605babf3e16c640a178" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0848d467793e47988abfd867f8b9cf8e"
I20260811 07:02:10.715268 31971 raft_consensus.cc:3037] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:10.715364 31824 raft_consensus.cc:3037] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:10.718252 31971 raft_consensus.cc:2454] T c7a9fb2937544823bc1cd3eba848d8be P 4072597c58614ffd85d9ae2689175fbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f90d25e25b74605babf3e16c640a178 in term 1.
I20260811 07:02:10.718499 31824 raft_consensus.cc:2454] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f90d25e25b74605babf3e16c640a178 in term 1.
I20260811 07:02:10.719065 32052 leader_election.cc:302] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4072597c58614ffd85d9ae2689175fbb, 8f90d25e25b74605babf3e16c640a178; no voters:
I20260811 07:02:10.719678 32207 raft_consensus.cc:2781] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:10.720273 32207 raft_consensus.cc:686] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [term 1 LEADER]: Becoming Leader. State: Replica: 8f90d25e25b74605babf3e16c640a178, State: Running, Role: LEADER
I20260811 07:02:10.721035 32207 consensus_queue.cc:237] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } }
I20260811 07:02:10.727061 31663 catalog_manager.cc:5495] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f90d25e25b74605babf3e16c640a178 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "8f90d25e25b74605babf3e16c640a178" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4072597c58614ffd85d9ae2689175fbb" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0848d467793e47988abfd867f8b9cf8e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f90d25e25b74605babf3e16c640a178" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46419 } health_report { overall_health: HEALTHY } } }
Aug 11 07:02:10 dist-test-slave-69rg krb5kdc[31611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
W20260811 07:02:10.771101 32177 tablet.cc:2369] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:02:10.773924 32194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.755949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53782 (local address 127.30.73.65:43945)
0811 07:02:10.756207 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.756217 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.756792 (+ 575us) server_negotiation.cc:407] Connection header received
0811 07:02:10.757033 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.757045 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.757142 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.757274 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:10.759194 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.760029 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.761483 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.762090 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.762247 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.767239 (+ 4992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:10.767261 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:10.767293 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:10.767341 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:10.770775 (+ 3434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.771831 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.771840 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.771842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.772010 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.772439 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.772443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.772445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.772833 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:10.773067 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.773357 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.773545 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
Aug 11 07:02:10 dist-test-slave-69rg krb5kdc[31611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431730, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:02:10 dist-test-slave-69rg krb5kdc[31611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431730, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:10.831784 32194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.816621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53790 (local address 127.30.73.65:43945)
0811 07:02:10.816886 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.816891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.817039 (+ 148us) server_negotiation.cc:407] Connection header received
0811 07:02:10.817178 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.817183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.817252 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.817346 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:10.818938 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.819688 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.821025 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.821599 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.821742 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.826308 (+ 4566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:10.826315 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:10.826320 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:10.826374 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:10.829037 (+ 2663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.829745 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.829750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.829752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.829964 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.830402 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.830406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.830409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.830686 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:10.830907 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.831227 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.831407 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
Aug 11 07:02:10 dist-test-slave-69rg krb5kdc[31611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260811 07:02:10.878193 31878 tablet.cc:2369] T c7a9fb2937544823bc1cd3eba848d8be P 0848d467793e47988abfd867f8b9cf8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 07:02:10 dist-test-slave-69rg krb5kdc[31611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:10.887740 32194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.871781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53800 (local address 127.30.73.65:43945)
0811 07:02:10.872052 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.872059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.872405 (+ 346us) server_negotiation.cc:407] Connection header received
0811 07:02:10.872551 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.872555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.872625 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.872719 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:10.874209 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.874941 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.876147 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.876591 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.876693 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.881754 (+ 5061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:10.881760 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:10.881764 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:10.881805 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:10.884692 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.885432 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.885437 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.885439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.885563 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.886074 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.886080 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.886083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.886465 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:10.886677 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.887136 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.887356 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 07:02:10.889662 31776 tablet_service.cc:2908] Rejecting scan request for tablet c7a9fb2937544823bc1cd3eba848d8be: Uninitialized: clean time has not yet been initialized
I20260811 07:02:10.893385 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 31730
I20260811 07:02:10.909113 32194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:10.894621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53808 (local address 127.30.73.65:43945)
0811 07:02:10.894893 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:10.894903 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:10.895422 (+ 519us) server_negotiation.cc:407] Connection header received
0811 07:02:10.895554 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:10.895558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:10.895636 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:10.895753 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:10.897038 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.897752 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.899207 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:10.899751 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:10.900060 (+ 309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:10.902538 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:10.902544 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:10.902548 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:10.902587 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:10.905743 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.906713 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.906718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.906721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.906867 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:10.907278 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:10.907282 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:10.907284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:10.907575 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:10.907836 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:10.908127 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 07:02:10.908334 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:02:10.910760 31872 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:11.007522 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 31730
I20260811 07:02:11.029152 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 31883
Aug 11 07:02:11 dist-test-slave-69rg krb5kdc[31611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:02:11.046500 32191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:11.030153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44216 (local address 127.30.73.66:36519)
0811 07:02:11.030327 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:11.030332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:11.030350 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:02:11.030406 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:11.030410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:11.030500 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:11.030590 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:11.031857 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:11.032688 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:11.034396 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:11.034847 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:11.034964 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:11.039952 (+ 4988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:11.039969 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:11.039987 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:11.040027 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:11.043486 (+ 3459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:11.044304 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:11.044312 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:11.044314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:11.044448 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:11.044870 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:11.044875 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:11.044877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:11.045317 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:11.045574 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:11.045948 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 07:02:11.046131 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:02:11.047355 32017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:11.138406 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 31883
W20260811 07:02:11.162124 32052 connection.cc:535] client connection to 127.30.73.66:36519 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 07:02:11.162434 32052 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:02:11.162562 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 32029
I20260811 07:02:11.164518 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:11.163988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:36519 (local address 127.30.73.67:56663)
0811 07:02:11.164161 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:11.164288 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.66:36519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 07:02:11.164789 32052 consensus_peers.cc:487] T c7a9fb2937544823bc1cd3eba848d8be P 8f90d25e25b74605babf3e16c640a178 -> Peer 4072597c58614ffd85d9ae2689175fbb (127.30.73.66:36519): Couldn't send request to peer 4072597c58614ffd85d9ae2689175fbb. Status: Network error: Client connection negotiation failed: client connection to 127.30.73.66:36519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
Aug 11 07:02:11 dist-test-slave-69rg krb5kdc[31611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:02:11.180043 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:11.164213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45296 (local address 127.30.73.67:46419)
0811 07:02:11.164697 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:11.164703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:11.164728 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:02:11.164818 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:11.164821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:11.164911 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:11.165025 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:11.166338 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:11.167140 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:11.168516 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:11.169016 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:11.169137 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:11.174156 (+ 5019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:11.174172 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:11.174190 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:11.174238 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:11.177319 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:11.178160 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:11.178168 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:11.178171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:11.178338 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:11.178724 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:11.178727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:11.178729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:11.179091 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:11.179346 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:11.179593 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 07:02:11.179775 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":226,"threads_started":1}
I20260811 07:02:11.180918 32171 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:11.275345 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:11.274736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:43945 (local address 127.30.73.67:51915)
0811 07:02:11.274947 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:11.275113 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 07:02:11.275362 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 32029
I20260811 07:02:11.300268 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 31627
I20260811 07:02:11.301703 31697 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:11.414662 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 31627
2026-08-11T07:02:11Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4757 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:11 dist-test-slave-69rg krb5kdc[32234](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:11 dist-test-slave-69rg krb5kdc[32234](info): set up 2 sockets
Aug 11 07:02:11 dist-test-slave-69rg krb5kdc[32234](info): commencing operation
krb5kdc: starting...
W20260811 07:02:12.614024 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.003s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:12 dist-test-slave-69rg krb5kdc[32234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:12.838971 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:34689
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:34689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:13.195233 32250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:13.195582 32250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:13.195679 32250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:13.203732 32250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:13.203891 32250 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:02:13.203953 32250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:13.204028 32250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:13.204092 32250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:13.204165 32250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:13.215492 32250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:34689
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:34689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:13.216846 32250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:13.218323 32250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:13.231056 32255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:13.231033 32256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:13.230988 32258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:13.235747 32250 server_base.cc:1034] running on GCE node
I20260811 07:02:13.236685 32250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:13.238267 32250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:13.239543 32250 hybrid_clock.cc:648] HybridClock initialized: now 1786431733239456 us; error 54 us; skew 500 ppm
I20260811 07:02:13.239919 32250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:13 dist-test-slave-69rg krb5kdc[32234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431733, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:13.243461 32250 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:13.244979 32250 webserver.cc:460] Webserver started at http://127.30.73.126:44895/ using document root <none> and password file <none>
I20260811 07:02:13.245697 32250 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:13.245788 32250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:13.246150 32250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:13.249159 32250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "1b14d1a01b574861a2131861b5d842da"
format_stamp: "Formatted at 2026-08-11 07:02:13 on dist-test-slave-69rg"
server_key: "b4ff15b898ccf4baab1abab41479e608"
server_key_iv: "fe4ae47bab73d75eb9a6893435d16b45"
server_key_version: "encryptionkey@0"
I20260811 07:02:13.250032 32250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "1b14d1a01b574861a2131861b5d842da"
format_stamp: "Formatted at 2026-08-11 07:02:13 on dist-test-slave-69rg"
server_key: "b4ff15b898ccf4baab1abab41479e608"
server_key_iv: "fe4ae47bab73d75eb9a6893435d16b45"
server_key_version: "encryptionkey@0"
I20260811 07:02:13.255620 32250 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:02:13.259225 32267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:13.260715 32250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:02:13.260890 32250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "1b14d1a01b574861a2131861b5d842da"
format_stamp: "Formatted at 2026-08-11 07:02:13 on dist-test-slave-69rg"
server_key: "b4ff15b898ccf4baab1abab41479e608"
server_key_iv: "fe4ae47bab73d75eb9a6893435d16b45"
server_key_version: "encryptionkey@0"
I20260811 07:02:13.261134 32250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:13.280154 32250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:13.284847 32250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:13.285090 32250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:13.309365 32250 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:34689
I20260811 07:02:13.309401 32333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:34689 every 8 connection(s)
I20260811 07:02:13.310873 32250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:13.312420 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 32250
I20260811 07:02:13.312673 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:13.313560 31013 external_mini_cluster.cc:1428] Setting key 9ed53f92b2e6de908130909e3e53cc22
I20260811 07:02:13.316097 32334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:02:13 dist-test-slave-69rg krb5kdc[32234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:13.331123 32334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da: Bootstrap starting.
I20260811 07:02:13.334990 32334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:13.336115 32334 log.cc:824] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:13.339555 32334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da: No bootstrap required, opened a new log
I20260811 07:02:13.339699 32338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:13.315847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57318 (local address 127.30.73.126:34689)
0811 07:02:13.316747 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:13.316759 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:13.316802 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:02:13.318575 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:13.318596 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:13.318999 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:13.319338 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:13.321281 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:13.322825 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:13.324638 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:13.325400 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:13.325555 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:13.331139 (+ 5584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:13.331149 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:13.331166 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:13.331252 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:13.335030 (+ 3778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:13.335827 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:13.335844 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:13.335851 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:13.336030 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:13.336462 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:13.336467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:13.336475 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:13.337309 (+ 834us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:13.337622 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:13.338187 (+ 565us) server_negotiation.cc:299] Negotiation successful
0811 07:02:13.338612 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":474,"threads_started":1}
I20260811 07:02:13.348493 32334 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b14d1a01b574861a2131861b5d842da" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34689 } }
I20260811 07:02:13.348975 32334 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:13.349092 32334 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b14d1a01b574861a2131861b5d842da, State: Initialized, Role: FOLLOWER
I20260811 07:02:13.349756 32334 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b14d1a01b574861a2131861b5d842da" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34689 } }
I20260811 07:02:13.350083 32334 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:13.350240 32334 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:13.350430 32334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:13.353037 32334 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b14d1a01b574861a2131861b5d842da" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34689 } }
I20260811 07:02:13.353807 32334 leader_election.cc:302] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b14d1a01b574861a2131861b5d842da; no voters:
I20260811 07:02:13.354573 32334 leader_election.cc:288] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:13.354738 32342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:13.355568 32342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [term 1 LEADER]: Becoming Leader. State: Replica: 1b14d1a01b574861a2131861b5d842da, State: Running, Role: LEADER
I20260811 07:02:13.356149 32342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b14d1a01b574861a2131861b5d842da" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34689 } }
I20260811 07:02:13.357064 32334 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:13.360836 32344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b14d1a01b574861a2131861b5d842da. Latest consensus state: current_term: 1 leader_uuid: "1b14d1a01b574861a2131861b5d842da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b14d1a01b574861a2131861b5d842da" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34689 } } }
I20260811 07:02:13.361366 32344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:13.362396 32343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b14d1a01b574861a2131861b5d842da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b14d1a01b574861a2131861b5d842da" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34689 } } }
I20260811 07:02:13.362720 32343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:13.365872 32351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:13.371803 32351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:13.381922 32351 catalog_manager.cc:1347] Generated new cluster ID: c92f7ef5fbd14982bf8ffd1dbbcf9eb3
I20260811 07:02:13.382051 32351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:13.409217 32351 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:13.410808 32351 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:13.419536 32351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da: Generated new TSK 0
I20260811 07:02:13.420773 32351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:02:13.498860 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:34689
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:13.857239 32365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:13.857620 32365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:13.857848 32365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:13.866587 32365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:13.866729 32365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:13.866890 32365 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:02:13.867014 32365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:13.877620 32365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.73.126:34689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:13.879084 32365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:13.880504 32365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:13.894486 32374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:13.894510 32372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:13.894462 32371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:13.895948 32365 server_base.cc:1034] running on GCE node
I20260811 07:02:13.896668 32365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:13.897675 32365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:13.898957 32365 hybrid_clock.cc:648] HybridClock initialized: now 1786431733898897 us; error 33 us; skew 500 ppm
I20260811 07:02:13.899340 32365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:13 dist-test-slave-69rg krb5kdc[32234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431733, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:13.908635 32365 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:02:13.910389 32365 webserver.cc:460] Webserver started at http://127.30.73.65:34065/ using document root <none> and password file <none>
I20260811 07:02:13.911180 32365 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:13.911329 32365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:13.911681 32365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:13.914935 32365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "d8f231796b364274a84b771c073a6e33"
format_stamp: "Formatted at 2026-08-11 07:02:13 on dist-test-slave-69rg"
server_key: "da28f74ab61d570c77b4349b88d0f494"
server_key_iv: "647b0148a01075a3e909094e4c05bbfe"
server_key_version: "encryptionkey@0"
I20260811 07:02:13.915833 32365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "d8f231796b364274a84b771c073a6e33"
format_stamp: "Formatted at 2026-08-11 07:02:13 on dist-test-slave-69rg"
server_key: "da28f74ab61d570c77b4349b88d0f494"
server_key_iv: "647b0148a01075a3e909094e4c05bbfe"
server_key_version: "encryptionkey@0"
I20260811 07:02:13.921689 32365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 07:02:13.925776 32381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:13.927250 32365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:02:13.927448 32365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "d8f231796b364274a84b771c073a6e33"
format_stamp: "Formatted at 2026-08-11 07:02:13 on dist-test-slave-69rg"
server_key: "da28f74ab61d570c77b4349b88d0f494"
server_key_iv: "647b0148a01075a3e909094e4c05bbfe"
server_key_version: "encryptionkey@0"
I20260811 07:02:13.927707 32365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:13.970003 32365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:13.974251 32365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:13.974565 32365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:13.977736 32365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:13.977860 32365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 07:02:13.978018 32365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:13.978114 32365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:02:13 dist-test-slave-69rg krb5kdc[32234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431733, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:14.003123 32390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:13.978459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:46229 (local address 127.30.73.126:34689)
0811 07:02:13.980955 (+ 2496us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:13.980962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:13.980985 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:02:13.982672 (+ 1687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:13.982677 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:13.982764 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:13.982891 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:13.985232 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:13.986328 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:13.989043 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:13.989624 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:13.989767 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:13.994414 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:13.994420 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:13.994424 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:13.994481 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:13.998427 (+ 3946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:13.999744 (+ 1317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:13.999750 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:13.999754 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:13.999925 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:14.000622 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:14.000630 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:14.000636 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:14.001064 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:14.001270 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:14.002442 (+ 1172us) server_negotiation.cc:299] Negotiation successful
0811 07:02:14.002704 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2362,"thread_start_us":2244,"threads_started":1}
I20260811 07:02:14.004419 32391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:13.979167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34689 (local address 127.30.73.65:46229)
0811 07:02:13.980245 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:13.980325 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:13.982384 (+ 2059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:13.983167 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:13.983181 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:13.984081 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:13.984954 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:13.984999 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:13.986510 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:13.986515 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:13.988896 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:13.988909 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:13.990059 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:13.990064 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:13.990253 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:13.990968 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:13.990993 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:13.994124 (+ 3131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:13.998613 (+ 4489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:13.998626 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:13.998652 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:13.999523 (+ 871us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:14.000084 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:14.000092 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:14.000096 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:14.000462 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:14.001238 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:14.001251 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:14.001805 (+ 554us) client_negotiation.cc:769] Sending connection context
0811 07:02:14.002313 (+ 508us) client_negotiation.cc:240] Negotiation successful
0811 07:02:14.002984 (+ 671us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":399,"threads_started":1}
I20260811 07:02:14.031531 32390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:14.012838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:40895 (local address 127.30.73.126:34689)
0811 07:02:14.013095 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:14.013105 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:14.013769 (+ 664us) server_negotiation.cc:407] Connection header received
0811 07:02:14.014098 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:14.014106 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:14.014199 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:14.014287 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:14.016239 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.017158 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.019750 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.020200 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.020329 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:14.023454 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:14.023460 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:14.023463 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:14.023500 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:14.027932 (+ 4432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:14.028825 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:14.028834 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:14.028840 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:14.029081 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:14.029542 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:14.029550 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:14.029556 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:14.030068 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:14.030290 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:14.030860 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 07:02:14.031124 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:02:14.031701 32471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:14.012791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34689 (local address 127.30.73.65:40895)
0811 07:02:14.013618 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:14.013646 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:14.013889 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:14.014566 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:14.014574 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:14.015424 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:14.016035 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:14.016057 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.017328 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.017336 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:14.019540 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:14.019563 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.020435 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.020444 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:14.020731 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:14.021701 (+ 970us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:14.021732 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:14.023202 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:14.028193 (+ 4991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:14.028198 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:14.028201 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:14.028668 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:14.029236 (+ 568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:14.029240 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:14.029242 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:14.029405 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:14.030236 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:14.030245 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:14.030518 (+ 273us) client_negotiation.cc:769] Sending connection context
0811 07:02:14.030746 (+ 228us) client_negotiation.cc:240] Negotiation successful
0811 07:02:14.031171 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":426,"threads_started":1}
I20260811 07:02:14.034271 32365 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:38375
I20260811 07:02:14.034271 32516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:38375 every 8 connection(s)
I20260811 07:02:14.035729 32365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:14.038039 32518 heartbeater.cc:347] Connected to a master server at 127.30.73.126:34689
I20260811 07:02:14.038273 32518 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:14.038941 32518 heartbeater.cc:511] Master 127.30.73.126:34689 requested a full tablet report, sending...
I20260811 07:02:14.041222 32284 ts_manager.cc:194] Registered new tserver with Master: d8f231796b364274a84b771c073a6e33 (127.30.73.65:38375)
I20260811 07:02:14.042835 32284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:46229
I20260811 07:02:14.045037 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 32365
I20260811 07:02:14.045259 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:14.045965 31013 external_mini_cluster.cc:1428] Setting key f002dd609c377d265d9e1eb1a2fadebe
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:02:14.099586 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:34689
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:14.450567 32523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:14.450886 32523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:14.451058 32523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:14.458820 32523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:14.458954 32523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:14.459124 32523 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:02:14.459280 32523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:14.469990 32523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.73.126:34689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:14.471364 32523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:14.472697 32523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:14.486640 32534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:14.486723 32529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:14.486697 32531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:14.487545 32523 server_base.cc:1034] running on GCE node
I20260811 07:02:14.488267 32523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:14.489318 32523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:14.490633 32523 hybrid_clock.cc:648] HybridClock initialized: now 1786431734490515 us; error 65 us; skew 500 ppm
I20260811 07:02:14.490988 32523 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:14 dist-test-slave-69rg krb5kdc[32234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431734, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:14.494555 32523 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:02:14.496148 32523 webserver.cc:460] Webserver started at http://127.30.73.66:40529/ using document root <none> and password file <none>
I20260811 07:02:14.496903 32523 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:14.497000 32523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:14.497298 32523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:14.500558 32523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "aa7c7d7d87a14607a0b74b54f355b297"
format_stamp: "Formatted at 2026-08-11 07:02:14 on dist-test-slave-69rg"
server_key: "521aa134ca3ee03f1f03ebcc1b16347a"
server_key_iv: "673c277849d6a8a134b1878b8f65e7e6"
server_key_version: "encryptionkey@0"
I20260811 07:02:14.501708 32523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "aa7c7d7d87a14607a0b74b54f355b297"
format_stamp: "Formatted at 2026-08-11 07:02:14 on dist-test-slave-69rg"
server_key: "521aa134ca3ee03f1f03ebcc1b16347a"
server_key_iv: "673c277849d6a8a134b1878b8f65e7e6"
server_key_version: "encryptionkey@0"
I20260811 07:02:14.507869 32523 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 07:02:14.512107 32542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:14.513940 32523 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:02:14.514173 32523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "aa7c7d7d87a14607a0b74b54f355b297"
format_stamp: "Formatted at 2026-08-11 07:02:14 on dist-test-slave-69rg"
server_key: "521aa134ca3ee03f1f03ebcc1b16347a"
server_key_iv: "673c277849d6a8a134b1878b8f65e7e6"
server_key_version: "encryptionkey@0"
I20260811 07:02:14.514464 32523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:14.538805 32523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:14.547058 32523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:14.547405 32523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:14.551020 32523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:14.551154 32523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:14.551347 32523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:14.551473 32523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 11 07:02:14 dist-test-slave-69rg krb5kdc[32234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431734, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:14.582209 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:14.552594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34689 (local address 127.30.73.66:55619)
0811 07:02:14.553922 (+ 1328us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:14.553982 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:14.557184 (+ 3202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:14.558873 (+ 1689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:14.558893 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:14.560142 (+ 1249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:14.561405 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:14.561456 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.563270 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.563279 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:14.566207 (+ 2928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:14.566235 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.567463 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.567471 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:14.567711 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:14.568533 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:14.568561 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:14.571957 (+ 3396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:14.576132 (+ 4175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:14.576149 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:14.576174 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:14.577087 (+ 913us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:14.577623 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:14.577628 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:14.577631 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:14.578030 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:14.578873 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:14.578880 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:14.579477 (+ 597us) client_negotiation.cc:769] Sending connection context
0811 07:02:14.579827 (+ 350us) client_negotiation.cc:240] Negotiation successful
0811 07:02:14.580478 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":918,"thread_start_us":574,"threads_started":1}
I20260811 07:02:14.583010 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:14.551627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:55619 (local address 127.30.73.126:34689)
0811 07:02:14.554998 (+ 3371us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:14.555003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:14.555024 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:02:14.557690 (+ 2666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:14.557700 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:14.557838 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:14.557941 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:14.561783 (+ 3842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.563004 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.566476 (+ 3472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.567162 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.567305 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:14.572290 (+ 4985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:14.572300 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:14.572316 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:14.572373 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:14.575937 (+ 3564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:14.577267 (+ 1330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:14.577275 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:14.577280 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:14.577472 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:14.578180 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:14.578185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:14.578188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:14.578625 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:14.578792 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:14.582103 (+ 3311us) server_negotiation.cc:299] Negotiation successful
0811 07:02:14.582448 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3255,"thread_start_us":3151,"threads_started":1}
I20260811 07:02:14.605997 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:14.588780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:41321 (local address 127.30.73.126:34689)
0811 07:02:14.589011 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:14.589019 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:14.589800 (+ 781us) server_negotiation.cc:407] Connection header received
0811 07:02:14.590070 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:14.590075 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:14.590169 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:14.590286 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:14.592017 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.593009 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.596134 (+ 3125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.596908 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.597049 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:14.599645 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:14.599651 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:14.599660 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:14.599695 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:14.603030 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:14.603763 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:14.603768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:14.603772 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:14.603922 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:14.604316 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:14.604321 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:14.604324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:14.604682 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:14.604844 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:14.605281 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 07:02:14.605624 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 07:02:14.606124 32635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:14.588753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34689 (local address 127.30.73.66:41321)
0811 07:02:14.589625 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:14.589659 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:14.589902 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:14.590446 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:14.590453 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:14.591279 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:14.591856 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:14.591868 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.593250 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.593260 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:14.595886 (+ 2626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:14.595916 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:14.597451 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:14.597460 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:14.597652 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:14.598475 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:14.598502 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:14.599428 (+ 926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:14.603184 (+ 3756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:14.603190 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:14.603194 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:14.603627 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:14.604047 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:14.604052 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:14.604056 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:14.604197 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:14.604807 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:14.604813 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:14.605005 (+ 192us) client_negotiation.cc:769] Sending connection context
0811 07:02:14.605165 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 07:02:14.605560 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":480,"threads_started":1}
I20260811 07:02:14.613273 32523 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:33947
I20260811 07:02:14.613297 32674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:33947 every 8 connection(s)
I20260811 07:02:14.614777 32523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:14.616987 32675 heartbeater.cc:347] Connected to a master server at 127.30.73.126:34689
I20260811 07:02:14.617193 32675 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:14.617871 32675 heartbeater.cc:511] Master 127.30.73.126:34689 requested a full tablet report, sending...
I20260811 07:02:14.619306 32284 ts_manager.cc:194] Registered new tserver with Master: aa7c7d7d87a14607a0b74b54f355b297 (127.30.73.66:33947)
I20260811 07:02:14.620127 32284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:55619
I20260811 07:02:14.622961 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 32523
I20260811 07:02:14.623183 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:14.623651 31013 external_mini_cluster.cc:1428] Setting key 78308b1ee014ca153529c1e6313c1e50
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:02:14.673632 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:34689
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:15.027793 32679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:15.028128 32679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:15.028234 32679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:15.036782 32679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:15.036921 32679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:15.037088 32679 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:02:15.037225 32679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:15.046064 32518 heartbeater.cc:503] Master 127.30.73.126:34689 was elected leader, sending a full tablet report...
I20260811 07:02:15.048954 32679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.73.126:34689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:15.050444 32679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:15.052739 32679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:15.069998 32687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:15.069969 32689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:15.070020 32691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:15.070848 32679 server_base.cc:1034] running on GCE node
I20260811 07:02:15.071612 32679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:15.072727 32679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:15.073992 32679 hybrid_clock.cc:648] HybridClock initialized: now 1786431735073855 us; error 82 us; skew 500 ppm
I20260811 07:02:15.074360 32679 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:15 dist-test-slave-69rg krb5kdc[32234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431735, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:15.078908 32679 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:02:15.080724 32679 webserver.cc:460] Webserver started at http://127.30.73.67:36017/ using document root <none> and password file <none>
I20260811 07:02:15.081554 32679 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:15.081709 32679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:15.082103 32679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:15.085523 32679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "489339401ac54732b6767bccc4d60048"
format_stamp: "Formatted at 2026-08-11 07:02:15 on dist-test-slave-69rg"
server_key: "c11204b1e4994fcaf15f54f53afda8ac"
server_key_iv: "48ada8486cf5f3a07a05c06783f72560"
server_key_version: "encryptionkey@0"
I20260811 07:02:15.086452 32679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "489339401ac54732b6767bccc4d60048"
format_stamp: "Formatted at 2026-08-11 07:02:15 on dist-test-slave-69rg"
server_key: "c11204b1e4994fcaf15f54f53afda8ac"
server_key_iv: "48ada8486cf5f3a07a05c06783f72560"
server_key_version: "encryptionkey@0"
I20260811 07:02:15.092654 32679 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:02:15.097164 32698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:15.098738 32679 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:02:15.098965 32679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "489339401ac54732b6767bccc4d60048"
format_stamp: "Formatted at 2026-08-11 07:02:15 on dist-test-slave-69rg"
server_key: "c11204b1e4994fcaf15f54f53afda8ac"
server_key_iv: "48ada8486cf5f3a07a05c06783f72560"
server_key_version: "encryptionkey@0"
I20260811 07:02:15.099234 32679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:15.113035 32679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:15.118304 32679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:15.118618 32679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:15.121652 32679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:15.121781 32679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:15.122013 32679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:15.122093 32679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:02:15 dist-test-slave-69rg krb5kdc[32234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431735, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:15.149312 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.122615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:52489 (local address 127.30.73.126:34689)
0811 07:02:15.123252 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:15.123259 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:15.124568 (+ 1309us) server_negotiation.cc:407] Connection header received
0811 07:02:15.126835 (+ 2267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:15.126844 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:15.126963 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:15.127122 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:15.129763 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.130927 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.133881 (+ 2954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.134323 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.134469 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.140705 (+ 6236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:15.140715 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:15.140723 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:15.140781 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:15.144604 (+ 3823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:15.145894 (+ 1290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:15.145900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:15.145904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:15.146070 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:15.146772 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:15.146778 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:15.146782 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:15.147247 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:15.147449 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:15.148613 (+ 1164us) server_negotiation.cc:299] Negotiation successful
0811 07:02:15.148879 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":376,"threads_started":1}
I20260811 07:02:15.150972 32710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.123339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34689 (local address 127.30.73.67:52489)
0811 07:02:15.124344 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:15.124411 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:15.126493 (+ 2082us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:15.127517 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:15.127529 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:15.128376 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:15.129437 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.129478 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.131118 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.131125 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.133667 (+ 2542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.133691 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.134616 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.134627 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.135011 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.136058 (+ 1047us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:15.136129 (+ 71us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:15.140354 (+ 4225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:15.144862 (+ 4508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:15.144877 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:15.144910 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:15.145689 (+ 779us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:15.146236 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:15.146244 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:15.146248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:15.146619 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:15.147559 (+ 940us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:15.147568 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:15.148171 (+ 603us) client_negotiation.cc:769] Sending connection context
0811 07:02:15.148502 (+ 331us) client_negotiation.cc:240] Negotiation successful
0811 07:02:15.149171 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":407,"threads_started":1}
I20260811 07:02:15.171746 32679 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:41161
I20260811 07:02:15.171747 363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:41161 every 8 connection(s)
I20260811 07:02:15.173339 32679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:15.175726 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 32679
I20260811 07:02:15.175946 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:15.176570 31013 external_mini_cluster.cc:1428] Setting key eb382e9bceb365e0db757edf10d78286
I20260811 07:02:15.176963 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.159002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:40627 (local address 127.30.73.126:34689)
0811 07:02:15.159258 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:15.159265 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:15.160058 (+ 793us) server_negotiation.cc:407] Connection header received
0811 07:02:15.160305 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:15.160311 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:15.160410 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:15.160526 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:15.162319 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.163376 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.166356 (+ 2980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.166862 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.167026 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.169797 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:15.169803 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:15.169807 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:15.169909 (+ 102us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:15.173050 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:15.174131 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:15.174137 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:15.174141 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:15.174313 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:15.175159 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:15.175166 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:15.175171 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:15.175574 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:15.175768 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:15.176263 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 07:02:15.176512 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 07:02:15.176990 342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.159151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34689 (local address 127.30.73.67:40627)
0811 07:02:15.159944 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:15.159968 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:15.160150 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:15.160652 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:15.160660 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:15.161487 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:15.162070 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.162092 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.163649 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.163659 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.166124 (+ 2465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.166153 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.167125 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.167133 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.167347 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.168354 (+ 1007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:15.168385 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:15.169551 (+ 1166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:15.173235 (+ 3684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:15.173245 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:15.173249 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:15.173987 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:15.174715 (+ 728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:15.174722 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:15.174726 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:15.174944 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:15.175727 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:15.175733 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:15.175965 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 07:02:15.176141 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 07:02:15.176509 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":452,"threads_started":1}
I20260811 07:02:15.176952 364 heartbeater.cc:347] Connected to a master server at 127.30.73.126:34689
I20260811 07:02:15.177959 364 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:15.178929 364 heartbeater.cc:511] Master 127.30.73.126:34689 requested a full tablet report, sending...
I20260811 07:02:15.180702 32283 ts_manager.cc:194] Registered new tserver with Master: 489339401ac54732b6767bccc4d60048 (127.30.73.67:41161)
I20260811 07:02:15.181932 32283 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:52489
I20260811 07:02:15.193068 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:02:15 dist-test-slave-69rg krb5kdc[32234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431735, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:02:15 dist-test-slave-69rg krb5kdc[32234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431735, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:15.250339 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.234163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57322 (local address 127.30.73.126:34689)
0811 07:02:15.234445 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:15.234454 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:15.234740 (+ 286us) server_negotiation.cc:407] Connection header received
0811 07:02:15.234908 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:15.234912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:15.234985 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:15.235083 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:15.236630 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.237385 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.238781 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.239225 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.239341 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.243632 (+ 4291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:15.243638 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:15.243641 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:15.243687 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:15.246635 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:15.247703 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:15.247710 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:15.247713 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:15.248094 (+ 381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:15.248719 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:15.248723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:15.248726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:15.249102 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:15.249356 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:15.249693 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 07:02:15.249951 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 07:02:15.255875 32283 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:02:15.263520 32283 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:15.288035 377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.276833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:33947 (local address 127.0.0.1:41316)
0811 07:02:15.278782 (+ 1949us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:15.278824 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:15.279016 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:15.280182 (+ 1166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:15.280197 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:15.280237 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:15.280735 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.280758 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.282653 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.282662 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.285053 (+ 2391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.285072 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.286970 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.286978 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.287221 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.287276 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 07:02:15.287425 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 07:02:15.287654 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1693,"thread_start_us":1557,"threads_started":1}
I20260811 07:02:15.288033 380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.277065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41316 (local address 127.30.73.66:33947)
0811 07:02:15.278381 (+ 1316us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:15.278393 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:15.279253 (+ 860us) server_negotiation.cc:407] Connection header received
0811 07:02:15.279367 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:15.279375 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:15.279644 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:15.279870 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:15.280955 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.282477 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.285224 (+ 2747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.286723 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.286902 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.287142 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:15.287506 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 07:02:15.287692 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1093,"thread_start_us":977,"threads_started":1}
I20260811 07:02:15.289628 379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.277003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41161 (local address 127.0.0.1:36262)
0811 07:02:15.279449 (+ 2446us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:15.279467 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:15.279571 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:15.281741 (+ 2170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:15.281745 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:15.281772 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:15.282129 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.282140 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.284484 (+ 2344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.284489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.286771 (+ 2282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.286787 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.288787 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.288794 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.288947 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.288980 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:02:15.289057 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 07:02:15.289202 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2303,"mutex_wait_us":1,"thread_start_us":2144,"threads_started":1}
I20260811 07:02:15.290572 381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.277678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36262 (local address 127.30.73.67:41161)
0811 07:02:15.281159 (+ 3481us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:15.281167 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:15.281198 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:02:15.281305 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:15.281313 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:15.281532 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:15.282324 (+ 792us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:15.282698 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.284273 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.286965 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.288555 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.289616 (+ 1061us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.289908 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:15.290011 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 07:02:15.290213 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3298,"thread_start_us":2153,"threads_started":1}
I20260811 07:02:15.290959 383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.279982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33284 (local address 127.30.73.65:38375)
0811 07:02:15.283045 (+ 3063us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:15.283053 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:15.283080 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:02:15.283178 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:15.283186 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:15.283397 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:15.283583 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:15.284294 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.285649 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.287723 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.289501 (+ 1778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.289649 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.289883 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:15.290464 (+ 581us) server_negotiation.cc:299] Negotiation successful
0811 07:02:15.290666 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2889,"thread_start_us":2724,"threads_started":1}
I20260811 07:02:15.291194 382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.279340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38375 (local address 127.0.0.1:33284)
0811 07:02:15.280482 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:15.280505 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:15.280665 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:15.283606 (+ 2941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:15.283612 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:15.283646 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:15.284057 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.284071 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.285793 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.285801 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.287536 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.287549 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.290039 (+ 2490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.290045 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.290253 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.290286 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:02:15.290391 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:02:15.290539 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":975,"mutex_wait_us":1,"thread_start_us":807,"threads_started":1}
I20260811 07:02:15.292613 32600 tablet_service.cc:1467] Processing CreateTablet for tablet 4f79537e324a4fdcbf08f3bb483cbb3a (DEFAULT_TABLE table=test-table [id=956a769b16a943379fa31dda9203bf04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:15.294291 32600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f79537e324a4fdcbf08f3bb483cbb3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:15.295290 32755 tablet_service.cc:1467] Processing CreateTablet for tablet 4f79537e324a4fdcbf08f3bb483cbb3a (DEFAULT_TABLE table=test-table [id=956a769b16a943379fa31dda9203bf04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:15.295651 32438 tablet_service.cc:1467] Processing CreateTablet for tablet 4f79537e324a4fdcbf08f3bb483cbb3a (DEFAULT_TABLE table=test-table [id=956a769b16a943379fa31dda9203bf04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:15.297012 32438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f79537e324a4fdcbf08f3bb483cbb3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:15.297030 32755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f79537e324a4fdcbf08f3bb483cbb3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:15.308895 384 tablet_bootstrap.cc:492] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: Bootstrap starting.
I20260811 07:02:15.312569 384 tablet_bootstrap.cc:654] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:15.314409 384 log.cc:824] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:15.317371 387 tablet_bootstrap.cc:492] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: Bootstrap starting.
I20260811 07:02:15.324340 387 tablet_bootstrap.cc:654] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:15.325335 385 tablet_bootstrap.cc:492] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: Bootstrap starting.
I20260811 07:02:15.326824 384 tablet_bootstrap.cc:492] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: No bootstrap required, opened a new log
I20260811 07:02:15.326937 387 log.cc:824] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:15.327221 384 ts_tablet_manager.cc:1397] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.000s
I20260811 07:02:15.329301 385 tablet_bootstrap.cc:654] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:15.330753 385 log.cc:824] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:15.340456 385 tablet_bootstrap.cc:492] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: No bootstrap required, opened a new log
I20260811 07:02:15.340873 385 ts_tablet_manager.cc:1397] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.010s
I20260811 07:02:15.344355 384 raft_consensus.cc:348] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } }
I20260811 07:02:15.344895 384 raft_consensus.cc:374] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:15.345029 387 tablet_bootstrap.cc:492] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: No bootstrap required, opened a new log
I20260811 07:02:15.345083 384 raft_consensus.cc:729] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa7c7d7d87a14607a0b74b54f355b297, State: Initialized, Role: FOLLOWER
I20260811 07:02:15.345392 387 ts_tablet_manager.cc:1397] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: Time spent bootstrapping tablet: real 0.028s user 0.016s sys 0.008s
I20260811 07:02:15.345857 384 consensus_queue.cc:260] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } }
I20260811 07:02:15.347218 32675 heartbeater.cc:503] Master 127.30.73.126:34689 was elected leader, sending a full tablet report...
I20260811 07:02:15.347986 384 ts_tablet_manager.cc:1428] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: Time spent starting tablet: real 0.019s user 0.010s sys 0.005s
I20260811 07:02:15.351256 385 raft_consensus.cc:348] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } }
I20260811 07:02:15.351671 385 raft_consensus.cc:374] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:15.351812 385 raft_consensus.cc:729] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8f231796b364274a84b771c073a6e33, State: Initialized, Role: FOLLOWER
I20260811 07:02:15.352463 385 consensus_queue.cc:260] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } }
I20260811 07:02:15.354723 385 ts_tablet_manager.cc:1428] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260811 07:02:15.356376 387 raft_consensus.cc:348] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } }
I20260811 07:02:15.356864 387 raft_consensus.cc:374] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:15.357017 387 raft_consensus.cc:729] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 489339401ac54732b6767bccc4d60048, State: Initialized, Role: FOLLOWER
I20260811 07:02:15.357966 387 consensus_queue.cc:260] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } }
I20260811 07:02:15.359289 364 heartbeater.cc:503] Master 127.30.73.126:34689 was elected leader, sending a full tablet report...
I20260811 07:02:15.359949 387 ts_tablet_manager.cc:1428] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
W20260811 07:02:15.366876 32676 tablet.cc:2369] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:02:15.426129 365 tablet.cc:2369] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:02:15.538667 32519 tablet.cc:2369] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:02:15.703437 393 raft_consensus.cc:482] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:15.703979 393 raft_consensus.cc:504] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } }
I20260811 07:02:15.706248 393 leader_election.cc:288] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 489339401ac54732b6767bccc4d60048 (127.30.73.67:41161), d8f231796b364274a84b771c073a6e33 (127.30.73.65:38375)
I20260811 07:02:15.717108 381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.706869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:48607 (local address 127.30.73.67:41161)
0811 07:02:15.707144 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:15.707152 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:15.708150 (+ 998us) server_negotiation.cc:407] Connection header received
0811 07:02:15.708504 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:15.708514 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:15.708618 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:15.708749 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:15.709668 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.710949 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.714297 (+ 3348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.715686 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.715892 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.715990 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:15.716616 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 07:02:15.716803 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260811 07:02:15.717108 383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.706970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:47303 (local address 127.30.73.65:38375)
0811 07:02:15.707198 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:15.707206 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:15.708151 (+ 945us) server_negotiation.cc:407] Connection header received
0811 07:02:15.708478 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:15.708486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:15.708618 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:15.708743 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:15.709668 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.710942 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.714299 (+ 3357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.715686 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.715892 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.715990 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:15.716616 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 07:02:15.716784 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:02:15.717342 399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.706874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38375 (local address 127.30.73.66:47303)
0811 07:02:15.707970 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:15.707993 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:15.708250 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:15.708778 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:15.708783 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:15.708831 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:15.709423 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.709446 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.711109 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.711114 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.714082 (+ 2968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.714102 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.716046 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.716051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.716363 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.716472 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 07:02:15.716563 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 07:02:15.716783 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":987,"mutex_wait_us":314,"spinlock_wait_cycles":70784,"thread_start_us":692,"threads_started":1}
I20260811 07:02:15.717679 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.706867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41161 (local address 127.30.73.66:48607)
0811 07:02:15.707968 (+ 1101us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:15.707993 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:15.708218 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:15.708778 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:15.708783 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:15.708820 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:15.709466 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.709480 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.711108 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.711114 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.714082 (+ 2968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:15.714102 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.716032 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.716039 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:15.716363 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.716434 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 07:02:15.716563 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 07:02:15.716783 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":892,"mutex_wait_us":348,"thread_start_us":608,"threads_started":1}
I20260811 07:02:15.718847 308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f79537e324a4fdcbf08f3bb483cbb3a" candidate_uuid: "aa7c7d7d87a14607a0b74b54f355b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489339401ac54732b6767bccc4d60048" is_pre_election: true
I20260811 07:02:15.718892 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f79537e324a4fdcbf08f3bb483cbb3a" candidate_uuid: "aa7c7d7d87a14607a0b74b54f355b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8f231796b364274a84b771c073a6e33" is_pre_election: true
I20260811 07:02:15.719556 308 raft_consensus.cc:2454] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa7c7d7d87a14607a0b74b54f355b297 in term 0.
I20260811 07:02:15.719624 32462 raft_consensus.cc:2454] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa7c7d7d87a14607a0b74b54f355b297 in term 0.
I20260811 07:02:15.720419 32546 leader_election.cc:302] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 489339401ac54732b6767bccc4d60048, aa7c7d7d87a14607a0b74b54f355b297, d8f231796b364274a84b771c073a6e33; no voters:
I20260811 07:02:15.720974 393 raft_consensus.cc:2781] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:15.721155 393 raft_consensus.cc:482] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:15.721287 393 raft_consensus.cc:3037] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:15.724021 393 raft_consensus.cc:504] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } }
I20260811 07:02:15.724820 393 leader_election.cc:288] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [CANDIDATE]: Term 1 election: Requested vote from peers 489339401ac54732b6767bccc4d60048 (127.30.73.67:41161), d8f231796b364274a84b771c073a6e33 (127.30.73.65:38375)
I20260811 07:02:15.725452 308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f79537e324a4fdcbf08f3bb483cbb3a" candidate_uuid: "aa7c7d7d87a14607a0b74b54f355b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489339401ac54732b6767bccc4d60048"
I20260811 07:02:15.725493 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f79537e324a4fdcbf08f3bb483cbb3a" candidate_uuid: "aa7c7d7d87a14607a0b74b54f355b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8f231796b364274a84b771c073a6e33"
I20260811 07:02:15.725728 308 raft_consensus.cc:3037] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:15.725754 32462 raft_consensus.cc:3037] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:15.728296 308 raft_consensus.cc:2454] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa7c7d7d87a14607a0b74b54f355b297 in term 1.
I20260811 07:02:15.728363 32462 raft_consensus.cc:2454] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa7c7d7d87a14607a0b74b54f355b297 in term 1.
I20260811 07:02:15.728839 32546 leader_election.cc:302] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 489339401ac54732b6767bccc4d60048, aa7c7d7d87a14607a0b74b54f355b297, d8f231796b364274a84b771c073a6e33; no voters:
I20260811 07:02:15.729264 393 raft_consensus.cc:2781] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:15.729802 393 raft_consensus.cc:686] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 1 LEADER]: Becoming Leader. State: Replica: aa7c7d7d87a14607a0b74b54f355b297, State: Running, Role: LEADER
I20260811 07:02:15.730552 393 consensus_queue.cc:237] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } }
I20260811 07:02:15.736447 32284 catalog_manager.cc:5495] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa7c7d7d87a14607a0b74b54f355b297 (127.30.73.66). New cstate: current_term: 1 leader_uuid: "aa7c7d7d87a14607a0b74b54f355b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } health_report { overall_health: UNKNOWN } } }
I20260811 07:02:15.873579 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:15.863840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41332 (local address 127.30.73.66:33947)
0811 07:02:15.864749 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:15.864786 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:15.865301 (+ 515us) server_negotiation.cc:407] Connection header received
0811 07:02:15.866051 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:15.866059 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:15.866207 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:15.866396 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:15.867133 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.868292 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.870315 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:15.870887 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:15.871070 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:15.871783 (+ 713us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:15.872625 (+ 842us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:15.872824 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:15.873010 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 07:02:15.873140 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":322,"threads_started":1}
I20260811 07:02:15.885142 308 raft_consensus.cc:1261] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Refusing update from remote peer aa7c7d7d87a14607a0b74b54f355b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:15.885147 32462 raft_consensus.cc:1261] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [term 1 FOLLOWER]: Refusing update from remote peer aa7c7d7d87a14607a0b74b54f355b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:15.886471 400 consensus_queue.cc:1035] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:15.886955 393 consensus_queue.cc:1035] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:15.901926 406 mvcc.cc:205] Tried to move back new op lower bound from 7317224390170935296 to 7317224389557477376. Current Snapshot: MvccSnapshot[applied={T|T < 7317224390170935296}]
I20260811 07:02:15.930704 32283 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:15.931216 32283 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:15.936115 32283 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da: Sending DeleteTablet for 3 replicas of tablet 4f79537e324a4fdcbf08f3bb483cbb3a
I20260811 07:02:15.937805 32600 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f79537e324a4fdcbf08f3bb483cbb3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:15 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:41316
I20260811 07:02:15.937858 32755 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f79537e324a4fdcbf08f3bb483cbb3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:15 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:36262
I20260811 07:02:15.937876 32438 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f79537e324a4fdcbf08f3bb483cbb3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:15 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:33284
I20260811 07:02:15.943463 32283 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:02:15.944628 32283 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:15.950224 417 tablet_replica.cc:330] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: stopping tablet replica
I20260811 07:02:15.950951 417 raft_consensus.cc:2229] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:15.951719 417 raft_consensus.cc:2258] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:15.952572 419 tablet_replica.cc:330] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: stopping tablet replica
I20260811 07:02:15.953272 418 tablet_replica.cc:330] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: stopping tablet replica
I20260811 07:02:15.953974 418 raft_consensus.cc:2229] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:15.954605 419 raft_consensus.cc:2229] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:02:15.955152 417 ts_tablet_manager.cc:1905] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:15.955879 418 raft_consensus.cc:2258] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:15.956338 419 raft_consensus.cc:2258] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:15.959563 418 ts_tablet_manager.cc:1905] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:15.960186 32438 tablet_service.cc:1467] Processing CreateTablet for tablet ed070ea908574a4ca3d4c1111ae1a87f (DEFAULT_TABLE table=test-table [id=400cf0c94bf04571a316849f7a144c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:15.960258 32755 tablet_service.cc:1467] Processing CreateTablet for tablet ed070ea908574a4ca3d4c1111ae1a87f (DEFAULT_TABLE table=test-table [id=400cf0c94bf04571a316849f7a144c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:15.960789 32438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed070ea908574a4ca3d4c1111ae1a87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:15.961238 32755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed070ea908574a4ca3d4c1111ae1a87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:15.963495 32600 tablet_service.cc:1467] Processing CreateTablet for tablet ed070ea908574a4ca3d4c1111ae1a87f (DEFAULT_TABLE table=test-table [id=400cf0c94bf04571a316849f7a144c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:15.964735 417 ts_tablet_manager.cc:1918] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:02:15.964999 417 log.cc:1196] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/4f79537e324a4fdcbf08f3bb483cbb3a
I20260811 07:02:15.965752 32600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed070ea908574a4ca3d4c1111ae1a87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:15.965746 417 ts_tablet_manager.cc:1939] T 4f79537e324a4fdcbf08f3bb483cbb3a P d8f231796b364274a84b771c073a6e33: Deleting consensus metadata
I20260811 07:02:15.968362 32269 catalog_manager.cc:4841] TS d8f231796b364274a84b771c073a6e33 (127.30.73.65:38375): tablet 4f79537e324a4fdcbf08f3bb483cbb3a (table test-table [id=956a769b16a943379fa31dda9203bf04]) successfully deleted
I20260811 07:02:15.976935 419 ts_tablet_manager.cc:1905] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:15.981557 420 tablet_bootstrap.cc:492] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: Bootstrap starting.
I20260811 07:02:15.981746 421 tablet_bootstrap.cc:492] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: Bootstrap starting.
I20260811 07:02:15.984663 421 tablet_bootstrap.cc:654] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:15.985270 418 ts_tablet_manager.cc:1918] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:02:15.985975 418 log.cc:1196] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/4f79537e324a4fdcbf08f3bb483cbb3a
I20260811 07:02:15.986989 422 tablet_bootstrap.cc:492] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: Bootstrap starting.
I20260811 07:02:15.987779 418 ts_tablet_manager.cc:1939] T 4f79537e324a4fdcbf08f3bb483cbb3a P 489339401ac54732b6767bccc4d60048: Deleting consensus metadata
I20260811 07:02:15.987830 420 tablet_bootstrap.cc:654] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:15.989306 422 tablet_bootstrap.cc:654] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:15.992417 32270 catalog_manager.cc:4841] TS 489339401ac54732b6767bccc4d60048 (127.30.73.67:41161): tablet 4f79537e324a4fdcbf08f3bb483cbb3a (table test-table [id=956a769b16a943379fa31dda9203bf04]) successfully deleted
I20260811 07:02:15.995021 421 tablet_bootstrap.cc:492] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: No bootstrap required, opened a new log
I20260811 07:02:15.995263 421 ts_tablet_manager.cc:1397] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.006s
I20260811 07:02:15.996279 419 ts_tablet_manager.cc:1918] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:02:15.996543 419 log.cc:1196] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/4f79537e324a4fdcbf08f3bb483cbb3a
I20260811 07:02:15.996798 421 raft_consensus.cc:348] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:15.997144 421 raft_consensus.cc:374] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:15.997275 421 raft_consensus.cc:729] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa7c7d7d87a14607a0b74b54f355b297, State: Initialized, Role: FOLLOWER
I20260811 07:02:15.997329 419 ts_tablet_manager.cc:1939] T 4f79537e324a4fdcbf08f3bb483cbb3a P aa7c7d7d87a14607a0b74b54f355b297: Deleting consensus metadata
I20260811 07:02:15.997346 420 tablet_bootstrap.cc:492] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: No bootstrap required, opened a new log
I20260811 07:02:15.997689 420 ts_tablet_manager.cc:1397] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.000s
I20260811 07:02:15.997711 421 consensus_queue.cc:260] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:15.998587 421 ts_tablet_manager.cc:1428] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 07:02:15.999684 422 tablet_bootstrap.cc:492] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: No bootstrap required, opened a new log
I20260811 07:02:15.999891 422 ts_tablet_manager.cc:1397] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260811 07:02:16.000466 32269 catalog_manager.cc:4841] TS aa7c7d7d87a14607a0b74b54f355b297 (127.30.73.66:33947): tablet 4f79537e324a4fdcbf08f3bb483cbb3a (table test-table [id=956a769b16a943379fa31dda9203bf04]) successfully deleted
I20260811 07:02:16.000885 422 raft_consensus.cc:348] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.001189 422 raft_consensus.cc:374] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:16.001308 422 raft_consensus.cc:729] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 489339401ac54732b6767bccc4d60048, State: Initialized, Role: FOLLOWER
I20260811 07:02:16.001863 422 consensus_queue.cc:260] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.003618 420 raft_consensus.cc:348] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.003978 420 raft_consensus.cc:374] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:16.004216 420 raft_consensus.cc:729] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8f231796b364274a84b771c073a6e33, State: Initialized, Role: FOLLOWER
I20260811 07:02:16.004791 420 consensus_queue.cc:260] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.006196 420 ts_tablet_manager.cc:1428] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260811 07:02:16.007467 422 ts_tablet_manager.cc:1428] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 07:02:16.183804 408 raft_consensus.cc:482] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:16.184269 408 raft_consensus.cc:504] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.191680 408 leader_election.cc:288] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa7c7d7d87a14607a0b74b54f355b297 (127.30.73.66:33947), 489339401ac54732b6767bccc4d60048 (127.30.73.67:41161)
I20260811 07:02:16.211874 381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.191313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:38125 (local address 127.30.73.67:41161)
0811 07:02:16.191550 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.191559 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.204191 (+ 12632us) server_negotiation.cc:407] Connection header received
0811 07:02:16.204613 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.204621 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.204731 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.204818 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:16.205836 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.207074 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.209634 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.210667 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.210872 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.210967 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.211342 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.211521 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 07:02:16.212177 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.189124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:48871 (local address 127.30.73.66:33947)
0811 07:02:16.189428 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.189439 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.202736 (+ 13297us) server_negotiation.cc:407] Connection header received
0811 07:02:16.203218 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.203233 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.203354 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.203440 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:16.205012 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.206316 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.209505 (+ 3189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.211037 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.211256 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.211359 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.211684 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.211863 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 07:02:16.212771 427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.188406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:33947 (local address 127.30.73.65:48871)
0811 07:02:16.202463 (+ 14057us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:16.202518 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:16.202956 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:16.204120 (+ 1164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:16.204127 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:16.204186 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:16.204783 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.204803 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.206541 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.206547 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.209275 (+ 2728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.209294 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.211315 (+ 2021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.211321 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.211509 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.211538 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:02:16.211635 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 07:02:16.211795 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13325,"mutex_wait_us":1,"thread_start_us":15331,"threads_started":1}
I20260811 07:02:16.212797 426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.190446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41161 (local address 127.30.73.65:38125)
0811 07:02:16.204066 (+ 13620us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:16.204089 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:16.204368 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:16.205120 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:16.205124 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:16.205157 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:16.205584 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.205599 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.207280 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.207285 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.209457 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.209472 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.210885 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.210891 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.211095 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.211126 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:02:16.212183 (+ 1057us) client_negotiation.cc:240] Negotiation successful
0811 07:02:16.212344 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12874,"mutex_wait_us":41,"spinlock_wait_cycles":7424,"thread_start_us":11378,"threads_started":1}
I20260811 07:02:16.213765 308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed070ea908574a4ca3d4c1111ae1a87f" candidate_uuid: "d8f231796b364274a84b771c073a6e33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489339401ac54732b6767bccc4d60048" is_pre_election: true
I20260811 07:02:16.214234 308 raft_consensus.cc:2454] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8f231796b364274a84b771c073a6e33 in term 0.
I20260811 07:02:16.214062 32623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed070ea908574a4ca3d4c1111ae1a87f" candidate_uuid: "d8f231796b364274a84b771c073a6e33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa7c7d7d87a14607a0b74b54f355b297" is_pre_election: true
I20260811 07:02:16.214717 32623 raft_consensus.cc:2454] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8f231796b364274a84b771c073a6e33 in term 0.
I20260811 07:02:16.214915 32384 leader_election.cc:302] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 489339401ac54732b6767bccc4d60048, d8f231796b364274a84b771c073a6e33; no voters:
I20260811 07:02:16.215520 408 raft_consensus.cc:2781] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:16.215679 408 raft_consensus.cc:482] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:16.215794 408 raft_consensus.cc:3037] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:16.219594 408 raft_consensus.cc:504] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.220460 408 leader_election.cc:288] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [CANDIDATE]: Term 1 election: Requested vote from peers aa7c7d7d87a14607a0b74b54f355b297 (127.30.73.66:33947), 489339401ac54732b6767bccc4d60048 (127.30.73.67:41161)
I20260811 07:02:16.221215 308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed070ea908574a4ca3d4c1111ae1a87f" candidate_uuid: "d8f231796b364274a84b771c073a6e33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489339401ac54732b6767bccc4d60048"
I20260811 07:02:16.221518 308 raft_consensus.cc:3037] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:16.221657 32623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed070ea908574a4ca3d4c1111ae1a87f" candidate_uuid: "d8f231796b364274a84b771c073a6e33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa7c7d7d87a14607a0b74b54f355b297"
I20260811 07:02:16.221951 32623 raft_consensus.cc:3037] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:16.224570 308 raft_consensus.cc:2454] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8f231796b364274a84b771c073a6e33 in term 1.
I20260811 07:02:16.225188 32623 raft_consensus.cc:2454] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8f231796b364274a84b771c073a6e33 in term 1.
I20260811 07:02:16.225272 32384 leader_election.cc:302] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 489339401ac54732b6767bccc4d60048, d8f231796b364274a84b771c073a6e33; no voters:
I20260811 07:02:16.225744 408 raft_consensus.cc:2781] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:16.226368 408 raft_consensus.cc:686] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 1 LEADER]: Becoming Leader. State: Replica: d8f231796b364274a84b771c073a6e33, State: Running, Role: LEADER
I20260811 07:02:16.226902 408 consensus_queue.cc:237] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.232066 32283 catalog_manager.cc:5495] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8f231796b364274a84b771c073a6e33 (127.30.73.65). New cstate: current_term: 1 leader_uuid: "d8f231796b364274a84b771c073a6e33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } health_report { overall_health: UNKNOWN } } }
Aug 11 07:02:16 dist-test-slave-69rg krb5kdc[32234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431733, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:16.362556 438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.333880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34689 (local address 127.0.0.1:57326)
0811 07:02:16.337710 (+ 3830us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:16.337748 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:16.338081 (+ 333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:16.338648 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:16.338653 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:16.340005 (+ 1352us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:16.340400 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.340420 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.341793 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.341801 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.343847 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.343867 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.344824 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.344833 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.345044 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.350446 (+ 5402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:16.350485 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:16.354458 (+ 3973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:16.358871 (+ 4413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:16.358891 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:16.358901 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:16.359658 (+ 757us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:16.360078 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:16.360085 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:16.360090 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:16.360280 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:16.361035 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:16.361045 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:16.361296 (+ 251us) client_negotiation.cc:769] Sending connection context
0811 07:02:16.361535 (+ 239us) client_negotiation.cc:240] Negotiation successful
0811 07:02:16.361995 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3596,"thread_start_us":3371,"threads_started":1}
I20260811 07:02:16.362576 437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.333862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57326 (local address 127.30.73.126:34689)
0811 07:02:16.338264 (+ 4402us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.338269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.338293 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:02:16.338349 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.338352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.338418 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.338528 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:16.340669 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.341611 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.344065 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.344592 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.344718 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.354882 (+ 10164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:16.354888 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:16.354892 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:16.354937 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:16.358664 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.359805 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.359810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.359812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.359953 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.360407 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.360411 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.360413 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.360865 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:16.361069 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.361700 (+ 631us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.362222 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":208,"server-negotiator.queue_time_us":4277,"thread_start_us":4066,"threads_started":1}
I20260811 07:02:16.370707 32283 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:57326:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:02:16.372552 32283 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:16.382063 32438 tablet_service.cc:1467] Processing CreateTablet for tablet 0e4c1614d1894a65b1b6fc89a3f060c5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8151f71611534f33ad5ebf749a2b8937]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:02:16.382069 32600 tablet_service.cc:1467] Processing CreateTablet for tablet 0e4c1614d1894a65b1b6fc89a3f060c5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8151f71611534f33ad5ebf749a2b8937]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:02:16.382259 32755 tablet_service.cc:1467] Processing CreateTablet for tablet 0e4c1614d1894a65b1b6fc89a3f060c5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8151f71611534f33ad5ebf749a2b8937]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:02:16.382886 32600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e4c1614d1894a65b1b6fc89a3f060c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:16.382884 32438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e4c1614d1894a65b1b6fc89a3f060c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:16.382936 32755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e4c1614d1894a65b1b6fc89a3f060c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:16.392345 422 tablet_bootstrap.cc:492] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: Bootstrap starting.
I20260811 07:02:16.392345 420 tablet_bootstrap.cc:492] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: Bootstrap starting.
I20260811 07:02:16.393311 421 tablet_bootstrap.cc:492] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: Bootstrap starting.
I20260811 07:02:16.394812 420 tablet_bootstrap.cc:654] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:16.394819 422 tablet_bootstrap.cc:654] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:16.395663 421 tablet_bootstrap.cc:654] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:16.406417 421 tablet_bootstrap.cc:492] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: No bootstrap required, opened a new log
I20260811 07:02:16.406821 421 ts_tablet_manager.cc:1397] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.003s
I20260811 07:02:16.407137 420 tablet_bootstrap.cc:492] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: No bootstrap required, opened a new log
I20260811 07:02:16.407394 420 ts_tablet_manager.cc:1397] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.004s
I20260811 07:02:16.408316 422 tablet_bootstrap.cc:492] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: No bootstrap required, opened a new log
I20260811 07:02:16.408565 422 ts_tablet_manager.cc:1397] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.009s
I20260811 07:02:16.408325 421 raft_consensus.cc:348] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.408929 421 raft_consensus.cc:374] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:16.408818 420 raft_consensus.cc:348] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.409158 420 raft_consensus.cc:374] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:16.409263 420 raft_consensus.cc:729] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8f231796b364274a84b771c073a6e33, State: Initialized, Role: FOLLOWER
I20260811 07:02:16.409276 421 raft_consensus.cc:729] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa7c7d7d87a14607a0b74b54f355b297, State: Initialized, Role: FOLLOWER
I20260811 07:02:16.409623 422 raft_consensus.cc:348] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.409962 422 raft_consensus.cc:374] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:16.410075 422 raft_consensus.cc:729] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 489339401ac54732b6767bccc4d60048, State: Initialized, Role: FOLLOWER
I20260811 07:02:16.409790 421 consensus_queue.cc:260] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.410393 422 consensus_queue.cc:260] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.410827 400 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.409624 420 consensus_queue.cc:260] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.410956 407 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.411278 400 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:16.411373 407 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:16.412107 420 ts_tablet_manager.cc:1428] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 07:02:16.412420 408 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.412818 408 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:16.413342 421 ts_tablet_manager.cc:1428] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260811 07:02:16.414659 422 ts_tablet_manager.cc:1428] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 07:02:16.493464 400 raft_consensus.cc:482] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:16.493883 400 raft_consensus.cc:504] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.494930 400 leader_election.cc:288] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8f231796b364274a84b771c073a6e33 (127.30.73.65:38375), 489339401ac54732b6767bccc4d60048 (127.30.73.67:41161)
I20260811 07:02:16.495638 308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e4c1614d1894a65b1b6fc89a3f060c5" candidate_uuid: "aa7c7d7d87a14607a0b74b54f355b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489339401ac54732b6767bccc4d60048" is_pre_election: true
I20260811 07:02:16.495666 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e4c1614d1894a65b1b6fc89a3f060c5" candidate_uuid: "aa7c7d7d87a14607a0b74b54f355b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8f231796b364274a84b771c073a6e33" is_pre_election: true
I20260811 07:02:16.495990 32462 raft_consensus.cc:2454] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa7c7d7d87a14607a0b74b54f355b297 in term 0.
I20260811 07:02:16.495998 308 raft_consensus.cc:2454] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa7c7d7d87a14607a0b74b54f355b297 in term 0.
I20260811 07:02:16.496521 32545 leader_election.cc:302] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa7c7d7d87a14607a0b74b54f355b297, d8f231796b364274a84b771c073a6e33; no voters:
I20260811 07:02:16.496889 400 raft_consensus.cc:2781] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:16.497009 400 raft_consensus.cc:482] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:16.497120 400 raft_consensus.cc:3037] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:16.500854 400 raft_consensus.cc:504] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.501786 400 leader_election.cc:288] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [CANDIDATE]: Term 1 election: Requested vote from peers d8f231796b364274a84b771c073a6e33 (127.30.73.65:38375), 489339401ac54732b6767bccc4d60048 (127.30.73.67:41161)
I20260811 07:02:16.502471 308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e4c1614d1894a65b1b6fc89a3f060c5" candidate_uuid: "aa7c7d7d87a14607a0b74b54f355b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489339401ac54732b6767bccc4d60048"
I20260811 07:02:16.502825 308 raft_consensus.cc:3037] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:16.502846 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e4c1614d1894a65b1b6fc89a3f060c5" candidate_uuid: "aa7c7d7d87a14607a0b74b54f355b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8f231796b364274a84b771c073a6e33"
I20260811 07:02:16.503123 32462 raft_consensus.cc:3037] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:16.507036 308 raft_consensus.cc:2454] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa7c7d7d87a14607a0b74b54f355b297 in term 1.
I20260811 07:02:16.506969 32462 raft_consensus.cc:2454] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa7c7d7d87a14607a0b74b54f355b297 in term 1.
I20260811 07:02:16.511075 32546 leader_election.cc:302] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 489339401ac54732b6767bccc4d60048, aa7c7d7d87a14607a0b74b54f355b297; no voters:
I20260811 07:02:16.511549 400 raft_consensus.cc:2781] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:16.512231 400 raft_consensus.cc:686] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [term 1 LEADER]: Becoming Leader. State: Replica: aa7c7d7d87a14607a0b74b54f355b297, State: Running, Role: LEADER
I20260811 07:02:16.512643 400 consensus_queue.cc:237] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } }
I20260811 07:02:16.515857 443 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: TxnStatusTablet state changed. Reason: New leader aa7c7d7d87a14607a0b74b54f355b297. Latest consensus state: current_term: 1 leader_uuid: "aa7c7d7d87a14607a0b74b54f355b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.516316 443 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:02:16.517036 445 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:02:16.517311 445 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:02:16.518196 32283 catalog_manager.cc:5495] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa7c7d7d87a14607a0b74b54f355b297 (127.30.73.66). New cstate: current_term: 1 leader_uuid: "aa7c7d7d87a14607a0b74b54f355b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } health_report { overall_health: UNKNOWN } } }
I20260811 07:02:16.554687 438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.546089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:33947 (local address 127.0.0.1:41336)
0811 07:02:16.546458 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:16.546483 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:16.546668 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:16.547627 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:16.547632 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:16.547646 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:02:16.547874 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.547890 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.549656 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.549662 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.551454 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.551473 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.552714 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.552721 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.552956 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.553119 (+ 163us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:02:16.553792 (+ 673us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:02:16.553862 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 07:02:16.553960 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 07:02:16.554202 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 07:02:16.555650 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.546086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41336 (local address 127.30.73.66:33947)
0811 07:02:16.547027 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.547035 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.547056 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:02:16.547158 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.547167 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.547274 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.547385 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:16.548075 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.549439 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.551661 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.552420 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.552561 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.553428 (+ 867us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:16.553630 (+ 202us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:16.553733 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.555142 (+ 1409us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.555255 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":773}
I20260811 07:02:16.562855 32462 raft_consensus.cc:1261] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33 [term 1 FOLLOWER]: Refusing update from remote peer aa7c7d7d87a14607a0b74b54f355b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:16.563230 308 raft_consensus.cc:1261] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Refusing update from remote peer aa7c7d7d87a14607a0b74b54f355b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:16.564092 443 consensus_queue.cc:1035] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:16.564515 400 consensus_queue.cc:1035] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:16.579923 408 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: TxnStatusTablet state changed. Reason: New leader aa7c7d7d87a14607a0b74b54f355b297. Latest consensus state: current_term: 1 leader_uuid: "aa7c7d7d87a14607a0b74b54f355b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.580358 408 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:16.584751 407 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: TxnStatusTablet state changed. Reason: New leader aa7c7d7d87a14607a0b74b54f355b297. Latest consensus state: current_term: 1 leader_uuid: "aa7c7d7d87a14607a0b74b54f355b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.585160 449 mvcc.cc:205] Tried to move back new op lower bound from 7317224392951107584 to 7317224392759595008. Current Snapshot: MvccSnapshot[applied={T|T < 7317224392951107584}]
I20260811 07:02:16.585289 407 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:16.595077 443 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa7c7d7d87a14607a0b74b54f355b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.595675 443 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:02:16.597259 443 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa7c7d7d87a14607a0b74b54f355b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.597718 443 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P aa7c7d7d87a14607a0b74b54f355b297: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:02:16.598713 407 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa7c7d7d87a14607a0b74b54f355b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.599076 407 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P 489339401ac54732b6767bccc4d60048: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:16.602702 408 tablet_replica.cc:439] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa7c7d7d87a14607a0b74b54f355b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8f231796b364274a84b771c073a6e33" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38375 } } peers { permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 } } peers { permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 } } }
I20260811 07:02:16.603142 408 tablet_replica.cc:442] T 0e4c1614d1894a65b1b6fc89a3f060c5 P d8f231796b364274a84b771c073a6e33: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:16.627516 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.614601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33286 (local address 127.30.73.65:38375)
0811 07:02:16.618507 (+ 3906us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.618515 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.618548 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:02:16.618745 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.618753 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.618897 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.619128 (+ 231us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:16.620000 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.621276 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.623514 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.624245 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.624988 (+ 743us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.625181 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:16.626094 (+ 913us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:16.626940 (+ 846us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.627001 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.627105 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3709,"thread_start_us":3525,"threads_started":1}
I20260811 07:02:16.649001 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.641925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:47521 (local address 127.30.73.66:33947)
0811 07:02:16.642209 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.642217 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.642872 (+ 655us) server_negotiation.cc:407] Connection header received
0811 07:02:16.643084 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.643089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.643232 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.643323 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:16.643929 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.644761 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.646912 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.647473 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.647574 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.648190 (+ 616us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:16.648338 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:16.648419 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.648664 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.648749 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 07:02:16.649184 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.641937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:33947 (local address 127.30.73.65:47521)
0811 07:02:16.642733 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:16.642755 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:16.642934 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:16.643366 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:16.643373 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:16.643388 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:02:16.643765 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.643777 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.644903 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.644910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.646721 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.646750 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.647672 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.647680 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.647873 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.647962 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:02:16.648453 (+ 491us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:02:16.648466 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 07:02:16.648560 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 07:02:16.648728 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":408,"threads_started":1}
I20260811 07:02:16.662087 307 raft_consensus.cc:1261] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Refusing update from remote peer d8f231796b364274a84b771c073a6e33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:16.662429 32623 raft_consensus.cc:1261] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [term 1 FOLLOWER]: Refusing update from remote peer d8f231796b364274a84b771c073a6e33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:16.662814 428 consensus_queue.cc:1035] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "489339401ac54732b6767bccc4d60048" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:16.663273 408 consensus_queue.cc:1035] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa7c7d7d87a14607a0b74b54f355b297" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:16.677644 448 mvcc.cc:205] Tried to move back new op lower bound from 7317224393360920576 to 7317224391590178816. Current Snapshot: MvccSnapshot[applied={T|T < 7317224393360920576}]
I20260811 07:02:16.715025 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.707983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:47295 (local address 127.30.73.65:38375)
0811 07:02:16.708167 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.708174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.708647 (+ 473us) server_negotiation.cc:407] Connection header received
0811 07:02:16.708876 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.708882 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.708960 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.709062 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:16.709919 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.710652 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.712631 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.713362 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.713533 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.714281 (+ 748us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:16.714396 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:16.714495 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.714643 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.714721 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:02:16.715258 465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.707549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38375 (local address 127.30.73.66:47295)
0811 07:02:16.708531 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:16.708552 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:16.708727 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:16.709235 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:16.709243 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:16.709257 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:02:16.709710 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.709726 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.710790 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.710798 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.712421 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:16.712442 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.713765 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.713775 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:16.714032 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.714098 (+ 66us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:02:16.714497 (+ 399us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:02:16.714512 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 07:02:16.714621 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 07:02:16.714770 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":627,"threads_started":1}
I20260811 07:02:16.766615 32282 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:16.766933 32282 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:16.771277 32282 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b14d1a01b574861a2131861b5d842da: Sending DeleteTablet for 3 replicas of tablet ed070ea908574a4ca3d4c1111ae1a87f
I20260811 07:02:16.772688 32755 tablet_service.cc:1514] Processing DeleteTablet for tablet ed070ea908574a4ca3d4c1111ae1a87f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:16 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:36262
I20260811 07:02:16.772681 32438 tablet_service.cc:1514] Processing DeleteTablet for tablet ed070ea908574a4ca3d4c1111ae1a87f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:16 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:33284
I20260811 07:02:16.773577 32600 tablet_service.cc:1514] Processing DeleteTablet for tablet ed070ea908574a4ca3d4c1111ae1a87f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:16 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:41316
I20260811 07:02:16.797747 472 tablet_replica.cc:330] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: stopping tablet replica
I20260811 07:02:16.798463 472 raft_consensus.cc:2229] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:02:16.800105 472 raft_consensus.cc:2258] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:16.802007 473 tablet_replica.cc:330] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: stopping tablet replica
I20260811 07:02:16.802248 473 raft_consensus.cc:2229] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:16.802551 473 raft_consensus.cc:2258] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:16.803921 473 ts_tablet_manager.cc:1905] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:16.803979 472 ts_tablet_manager.cc:1905] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:16.811861 471 tablet_replica.cc:330] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: stopping tablet replica
I20260811 07:02:16.815456 473 ts_tablet_manager.cc:1918] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:02:16.815807 473 log.cc:1196] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/ed070ea908574a4ca3d4c1111ae1a87f
I20260811 07:02:16.816015 471 raft_consensus.cc:2229] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:16.816417 471 raft_consensus.cc:2258] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:16.816438 473 ts_tablet_manager.cc:1939] T ed070ea908574a4ca3d4c1111ae1a87f P aa7c7d7d87a14607a0b74b54f355b297: Deleting consensus metadata
I20260811 07:02:16.817766 32269 catalog_manager.cc:4841] TS aa7c7d7d87a14607a0b74b54f355b297 (127.30.73.66:33947): tablet ed070ea908574a4ca3d4c1111ae1a87f (table test-table [id=400cf0c94bf04571a316849f7a144c2a]) successfully deleted
I20260811 07:02:16.820163 471 ts_tablet_manager.cc:1905] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 07:02:16 dist-test-slave-69rg krb5kdc[32234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431735, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:16.830055 472 ts_tablet_manager.cc:1918] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:02:16.830295 472 log.cc:1196] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/ed070ea908574a4ca3d4c1111ae1a87f
I20260811 07:02:16.830854 472 ts_tablet_manager.cc:1939] T ed070ea908574a4ca3d4c1111ae1a87f P d8f231796b364274a84b771c073a6e33: Deleting consensus metadata
I20260811 07:02:16.834087 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.796201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33302 (local address 127.30.73.65:38375)
0811 07:02:16.796412 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.796418 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.799395 (+ 2977us) server_negotiation.cc:407] Connection header received
0811 07:02:16.800692 (+ 1297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.800699 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.800807 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.800901 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:16.808066 (+ 7165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.809362 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.816738 (+ 7376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.817509 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.817646 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.824345 (+ 6699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:16.824364 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:16.824385 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:16.824443 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:16.829125 (+ 4682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.830539 (+ 1414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.830550 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.830554 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.830754 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.831403 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.831409 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.831412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.832053 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:16.832422 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.833014 (+ 592us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.833676 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:02:16.834300 32269 catalog_manager.cc:4841] TS d8f231796b364274a84b771c073a6e33 (127.30.73.65:38375): tablet ed070ea908574a4ca3d4c1111ae1a87f (table test-table [id=400cf0c94bf04571a316849f7a144c2a]) successfully deleted
W20260811 07:02:16.835888 32512 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33302
I20260811 07:02:16.839432 471 ts_tablet_manager.cc:1918] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:02:16.839622 471 log.cc:1196] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/ed070ea908574a4ca3d4c1111ae1a87f
I20260811 07:02:16.840379 471 ts_tablet_manager.cc:1939] T ed070ea908574a4ca3d4c1111ae1a87f P 489339401ac54732b6767bccc4d60048: Deleting consensus metadata
I20260811 07:02:16.841631 32270 catalog_manager.cc:4841] TS 489339401ac54732b6767bccc4d60048 (127.30.73.67:41161): tablet ed070ea908574a4ca3d4c1111ae1a87f (table test-table [id=400cf0c94bf04571a316849f7a144c2a]) successfully deleted
I20260811 07:02:16.866189 437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.839925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57334 (local address 127.30.73.126:34689)
0811 07:02:16.840189 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.840196 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.846454 (+ 6258us) server_negotiation.cc:407] Connection header received
0811 07:02:16.846666 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.846675 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.846880 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.847037 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:16.849016 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.850376 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.852453 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.853183 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.853459 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.857231 (+ 3772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:16.857239 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:16.857244 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:16.857303 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:16.861936 (+ 4633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.863072 (+ 1136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.863079 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.863083 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.863275 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.863921 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.863927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.863931 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.864386 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:16.864745 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.865163 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.865457 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260811 07:02:16.866966 32282 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57334
I20260811 07:02:16.869432 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 32365
I20260811 07:02:16.892107 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.872177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33308 (local address 127.30.73.65:38375)
0811 07:02:16.872417 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.872424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.873458 (+ 1034us) server_negotiation.cc:407] Connection header received
0811 07:02:16.873645 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.873651 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.873751 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.873936 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:16.876169 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.877357 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.879381 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.880137 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.880271 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.883577 (+ 3306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:16.883584 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:16.883589 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:16.883636 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:16.887648 (+ 4012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.888669 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.888675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.888679 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.888852 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.889313 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.889319 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.889322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.889788 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:16.890104 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.891405 (+ 1301us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.891693 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 07:02:16.893183 32512 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33308
W20260811 07:02:16.893875 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 32365: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:02:16.894085 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 32365
I20260811 07:02:16.918289 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 32523
Aug 11 07:02:16 dist-test-slave-69rg krb5kdc[32234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431735, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:02:16.938030 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.919136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41348 (local address 127.30.73.66:33947)
0811 07:02:16.919390 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.919397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.919461 (+ 64us) server_negotiation.cc:407] Connection header received
0811 07:02:16.919701 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.919707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.919804 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.919942 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:16.921320 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.922223 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.923483 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.924031 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.924187 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.929387 (+ 5200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:16.929411 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:16.929441 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:16.929506 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:16.934428 (+ 4922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.935435 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.935451 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.935454 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.935633 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.936114 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.936120 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.936123 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.936707 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:16.937055 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.937297 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.937554 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
W20260811 07:02:16.939003 32670 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41348
W20260811 07:02:16.939831 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 32523: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:02:16.940027 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 32523
I20260811 07:02:16.972857 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 32679
Aug 11 07:02:16 dist-test-slave-69rg krb5kdc[32234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431735, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:02:16.990126 481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:16.973695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36276 (local address 127.30.73.67:41161)
0811 07:02:16.974430 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:16.974435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:16.974459 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:02:16.974524 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:16.974528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:16.974594 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:16.974690 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:16.976230 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.976999 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.978465 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:16.978914 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:16.979022 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:16.983637 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:16.983657 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:16.983676 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:16.983722 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:16.986986 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.987840 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.987848 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.987850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.988011 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:16.988476 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:16.988480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:16.988482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:16.988882 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:16.989158 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:16.989503 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 07:02:16.989706 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":489,"threads_started":1}
W20260811 07:02:16.990865 357 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36276
W20260811 07:02:16.991575 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 32679: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:02:16.991742 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 32679
I20260811 07:02:17.023391 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 32250
I20260811 07:02:17.024705 32329 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:17.142207 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 32250
2026-08-11T07:02:17Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5727 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:17 dist-test-slave-69rg krb5kdc[485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:17 dist-test-slave-69rg krb5kdc[485](info): set up 2 sockets
Aug 11 07:02:17 dist-test-slave-69rg krb5kdc[485](info): commencing operation
krb5kdc: starting...
W20260811 07:02:18.354264 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:18 dist-test-slave-69rg krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:18.590423 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35667
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:35667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:18.932156 499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:18.932515 499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:18.932689 499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:18.939966 499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:18.940150 499 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:02:18.940249 499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:18.940363 499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:18.940452 499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:18.940546 499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:18.951297 499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:35667
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:18.952682 499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:18.954111 499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:18.966565 507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:18.966508 504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:18.966575 505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:18.967646 499 server_base.cc:1034] running on GCE node
I20260811 07:02:18.968478 499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:18.970245 499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:18.971520 499 hybrid_clock.cc:648] HybridClock initialized: now 1786431738971466 us; error 46 us; skew 500 ppm
I20260811 07:02:18.971874 499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:18 dist-test-slave-69rg krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431738, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:18.979445 499 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:18.981070 499 webserver.cc:460] Webserver started at http://127.30.73.126:41205/ using document root <none> and password file <none>
I20260811 07:02:18.981873 499 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:18.982002 499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:18.982347 499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:18.985630 499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "9d32f754854c4d659eca394dc8b6a943"
format_stamp: "Formatted at 2026-08-11 07:02:18 on dist-test-slave-69rg"
server_key: "f34bc268a9325ef2fd473900337d0775"
server_key_iv: "f6aacd58b5d0774548ea4aab825be15c"
server_key_version: "encryptionkey@0"
I20260811 07:02:18.986486 499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "9d32f754854c4d659eca394dc8b6a943"
format_stamp: "Formatted at 2026-08-11 07:02:18 on dist-test-slave-69rg"
server_key: "f34bc268a9325ef2fd473900337d0775"
server_key_iv: "f6aacd58b5d0774548ea4aab825be15c"
server_key_version: "encryptionkey@0"
I20260811 07:02:18.992007 499 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:18.995676 514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:18.997138 499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:02:18.997342 499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "9d32f754854c4d659eca394dc8b6a943"
format_stamp: "Formatted at 2026-08-11 07:02:18 on dist-test-slave-69rg"
server_key: "f34bc268a9325ef2fd473900337d0775"
server_key_iv: "f6aacd58b5d0774548ea4aab825be15c"
server_key_version: "encryptionkey@0"
I20260811 07:02:18.997593 499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:19.011013 499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:19.015275 499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:19.015554 499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:19.037376 499 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:35667
I20260811 07:02:19.037408 583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:35667 every 8 connection(s)
I20260811 07:02:19.038822 499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:19.042730 584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:19.043547 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 499
I20260811 07:02:19.043789 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:19.044731 31013 external_mini_cluster.cc:1428] Setting key d961e842831874d8d76d132a19572d5f
I20260811 07:02:19.058257 584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943: Bootstrap starting.
Aug 11 07:02:19 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:19.062575 584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:19.064080 584 log.cc:824] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:19.067294 584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943: No bootstrap required, opened a new log
I20260811 07:02:19.071468 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:19.046951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59968 (local address 127.30.73.126:35667)
0811 07:02:19.048054 (+ 1103us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:19.048071 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:19.048124 (+ 53us) server_negotiation.cc:407] Connection header received
0811 07:02:19.049890 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:19.049925 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:19.050345 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:19.050703 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:19.052625 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.054183 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.056079 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.056945 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.057172 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:19.062340 (+ 5168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:19.062350 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:19.062365 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:19.062408 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:19.065809 (+ 3401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:19.066659 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:19.066666 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:19.066672 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:19.066857 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:19.067260 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:19.067270 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:19.067272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:19.068410 (+ 1138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:19.069034 (+ 624us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:19.069877 (+ 843us) server_negotiation.cc:299] Negotiation successful
0811 07:02:19.070362 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":560,"threads_started":1}
I20260811 07:02:19.076638 584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d32f754854c4d659eca394dc8b6a943" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35667 } }
I20260811 07:02:19.077181 584 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:19.077772 584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d32f754854c4d659eca394dc8b6a943, State: Initialized, Role: FOLLOWER
I20260811 07:02:19.078604 584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d32f754854c4d659eca394dc8b6a943" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35667 } }
I20260811 07:02:19.078886 584 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:19.079033 584 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:19.079221 584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:19.081897 584 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d32f754854c4d659eca394dc8b6a943" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35667 } }
I20260811 07:02:19.082472 584 leader_election.cc:302] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d32f754854c4d659eca394dc8b6a943; no voters:
I20260811 07:02:19.083099 584 leader_election.cc:288] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:19.083266 589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:19.084100 589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [term 1 LEADER]: Becoming Leader. State: Replica: 9d32f754854c4d659eca394dc8b6a943, State: Running, Role: LEADER
I20260811 07:02:19.084694 589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d32f754854c4d659eca394dc8b6a943" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35667 } }
I20260811 07:02:19.085460 584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:19.088053 591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d32f754854c4d659eca394dc8b6a943. Latest consensus state: current_term: 1 leader_uuid: "9d32f754854c4d659eca394dc8b6a943" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d32f754854c4d659eca394dc8b6a943" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35667 } } }
I20260811 07:02:19.088135 590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d32f754854c4d659eca394dc8b6a943" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d32f754854c4d659eca394dc8b6a943" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35667 } } }
I20260811 07:02:19.088444 591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:19.088521 590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:19.099020 597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:19.104905 597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:19.113809 597 catalog_manager.cc:1347] Generated new cluster ID: 8bbf4239302a41ad9209fab2fce357e1
I20260811 07:02:19.113986 597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:19.141192 597 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:19.143191 597 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:19.154438 597 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943: Generated new TSK 0
I20260811 07:02:19.155539 597 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:02:19.215109 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35667
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:19.559809 610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:19.560132 610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:19.560307 610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:19.567605 610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:19.567757 610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:19.567912 610 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:02:19.567997 610 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:02:19.568133 610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:19.578660 610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.73.126:35667
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:19.580086 610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:19.581449 610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:19.596515 620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:19.596515 617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:19.596539 616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:19.597914 610 server_base.cc:1034] running on GCE node
I20260811 07:02:19.598743 610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:19.599967 610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:19.601203 610 hybrid_clock.cc:648] HybridClock initialized: now 1786431739601143 us; error 45 us; skew 500 ppm
I20260811 07:02:19.601629 610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:19 dist-test-slave-69rg krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431739, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:19.605711 610 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:02:19.607540 610 webserver.cc:460] Webserver started at http://127.30.73.65:36443/ using document root <none> and password file <none>
I20260811 07:02:19.608335 610 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:19.608489 610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:19.608842 610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:19.612175 610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "17aa696c61e1411c8bd95988c3396b5b"
format_stamp: "Formatted at 2026-08-11 07:02:19 on dist-test-slave-69rg"
server_key: "d49d979d91b74ddec8d1d5132612213e"
server_key_iv: "9df0de4ced5922972dc317625a2ecc05"
server_key_version: "encryptionkey@0"
I20260811 07:02:19.613055 610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "17aa696c61e1411c8bd95988c3396b5b"
format_stamp: "Formatted at 2026-08-11 07:02:19 on dist-test-slave-69rg"
server_key: "d49d979d91b74ddec8d1d5132612213e"
server_key_iv: "9df0de4ced5922972dc317625a2ecc05"
server_key_version: "encryptionkey@0"
I20260811 07:02:19.619988 610 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260811 07:02:19.624009 627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:19.625322 610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 07:02:19.625501 610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "17aa696c61e1411c8bd95988c3396b5b"
format_stamp: "Formatted at 2026-08-11 07:02:19 on dist-test-slave-69rg"
server_key: "d49d979d91b74ddec8d1d5132612213e"
server_key_iv: "9df0de4ced5922972dc317625a2ecc05"
server_key_version: "encryptionkey@0"
I20260811 07:02:19.625734 610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:19.654322 610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:19.658793 610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:19.659116 610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:19.662010 610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:19.662154 610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:19.662299 610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:19.662397 610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:02:19 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431739, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:19.699748 636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:19.663833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:37185 (local address 127.30.73.126:35667)
0811 07:02:19.670731 (+ 6898us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:19.670742 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:19.671761 (+ 1019us) server_negotiation.cc:407] Connection header received
0811 07:02:19.675813 (+ 4052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:19.675824 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:19.675935 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:19.676084 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:19.678914 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.679670 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.683003 (+ 3333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.683596 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.683786 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:19.690960 (+ 7174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:19.690971 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:19.690978 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:19.691034 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:19.695185 (+ 4151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:19.696173 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:19.696182 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:19.696188 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:19.696369 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:19.697035 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:19.697043 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:19.697049 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:19.697501 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:19.697680 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:19.698933 (+ 1253us) server_negotiation.cc:299] Negotiation successful
0811 07:02:19.699248 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6693,"thread_start_us":6538,"threads_started":1}
I20260811 07:02:19.701594 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:19.663646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35667 (local address 127.30.73.65:37185)
0811 07:02:19.671517 (+ 7871us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:19.671592 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:19.675347 (+ 3755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:19.676397 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:19.676409 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:19.677354 (+ 945us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:19.678604 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:19.678637 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.679875 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.679885 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:19.682769 (+ 2884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:19.682789 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.683943 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.683955 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:19.684409 (+ 454us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:19.685740 (+ 1331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:19.685778 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:19.690536 (+ 4758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:19.695453 (+ 4917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:19.695473 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:19.695504 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:19.696010 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:19.696531 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:19.696540 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:19.696545 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:19.696877 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:19.697668 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:19.697677 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:19.698381 (+ 704us) client_negotiation.cc:769] Sending connection context
0811 07:02:19.698778 (+ 397us) client_negotiation.cc:240] Negotiation successful
0811 07:02:19.699533 (+ 755us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7441,"thread_start_us":7136,"threads_started":1}
I20260811 07:02:19.714535 610 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:32943
I20260811 07:02:19.714592 761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:32943 every 8 connection(s)
I20260811 07:02:19.716017 610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:19.719295 762 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35667
I20260811 07:02:19.719614 762 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:19.719587 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 610
I20260811 07:02:19.719815 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:19.720691 31013 external_mini_cluster.cc:1428] Setting key feb7bdb7bb9d67f4e2fbff390c380b14
I20260811 07:02:19.721726 762 heartbeater.cc:511] Master 127.30.73.126:35667 requested a full tablet report, sending...
I20260811 07:02:19.723948 533 ts_manager.cc:194] Registered new tserver with Master: 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943)
I20260811 07:02:19.725399 533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:37185
I20260811 07:02:19.726089 750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:19.709880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35667 (local address 127.30.73.65:57499)
0811 07:02:19.710721 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:19.710748 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:19.710940 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:19.711551 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:19.711558 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:19.712309 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:19.712708 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:19.712723 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.714300 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.714304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:19.715477 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:19.715496 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.716370 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.716377 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:19.716592 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:19.717593 (+ 1001us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:19.717625 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:19.718871 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:19.722658 (+ 3787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:19.722664 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:19.722668 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:19.723244 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:19.723728 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:19.723735 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:19.723739 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:19.723904 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:19.724698 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:19.724707 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:19.724933 (+ 226us) client_negotiation.cc:769] Sending connection context
0811 07:02:19.725097 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 07:02:19.725497 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":432,"threads_started":1}
I20260811 07:02:19.726827 636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:19.709867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:57499 (local address 127.30.73.126:35667)
0811 07:02:19.710103 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:19.710112 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:19.710858 (+ 746us) server_negotiation.cc:407] Connection header received
0811 07:02:19.711106 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:19.711115 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:19.711207 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:19.711334 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:19.712950 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.714110 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.715647 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:19.716109 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:19.716270 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:19.719074 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:19.719079 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:19.719082 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:19.719134 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:19.722524 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:19.723416 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:19.723421 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:19.723424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:19.723582 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:19.724049 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:19.724057 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:19.724063 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:19.724475 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:19.724629 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:19.726028 (+ 1399us) server_negotiation.cc:299] Negotiation successful
0811 07:02:19.726458 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:02:19.774963 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35667
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:20.133963 766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:20.134385 766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:20.134567 766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:20.142369 766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:20.142549 766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:20.142699 766 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:02:20.142791 766 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:02:20.142928 766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:20.153482 766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.73.126:35667
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:20.155030 766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:20.156411 766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:20.171427 772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:20.171386 773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:20.171386 775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:20.172521 766 server_base.cc:1034] running on GCE node
I20260811 07:02:20.173316 766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:20.174621 766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:20.175906 766 hybrid_clock.cc:648] HybridClock initialized: now 1786431740175869 us; error 54 us; skew 500 ppm
I20260811 07:02:20.176307 766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:20 dist-test-slave-69rg krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431740, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:20.180223 766 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:02:20.182133 766 webserver.cc:460] Webserver started at http://127.30.73.66:40231/ using document root <none> and password file <none>
I20260811 07:02:20.182971 766 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:20.183152 766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:20.183519 766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:20.187232 766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "17753be418ba4ee8bd2bf858347a6ac1"
format_stamp: "Formatted at 2026-08-11 07:02:20 on dist-test-slave-69rg"
server_key: "1f12ddf82f090c65998755488890f7db"
server_key_iv: "1fd8d79e4aabf683045c6171855b07e4"
server_key_version: "encryptionkey@0"
I20260811 07:02:20.188161 766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "17753be418ba4ee8bd2bf858347a6ac1"
format_stamp: "Formatted at 2026-08-11 07:02:20 on dist-test-slave-69rg"
server_key: "1f12ddf82f090c65998755488890f7db"
server_key_iv: "1fd8d79e4aabf683045c6171855b07e4"
server_key_version: "encryptionkey@0"
I20260811 07:02:20.194710 766 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 07:02:20.198658 782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:20.200309 766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:02:20.200557 766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "17753be418ba4ee8bd2bf858347a6ac1"
format_stamp: "Formatted at 2026-08-11 07:02:20 on dist-test-slave-69rg"
server_key: "1f12ddf82f090c65998755488890f7db"
server_key_iv: "1fd8d79e4aabf683045c6171855b07e4"
server_key_version: "encryptionkey@0"
I20260811 07:02:20.200824 766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:20.220450 766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:20.225291 766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:20.225637 766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:20.228973 766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:20.229105 766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:20.229255 766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:20.229363 766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:02:20 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431740, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:20.255417 792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.229570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:55781 (local address 127.30.73.126:35667)
0811 07:02:20.230143 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:20.230152 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:20.231503 (+ 1351us) server_negotiation.cc:407] Connection header received
0811 07:02:20.233721 (+ 2218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:20.233727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:20.233853 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:20.233995 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:20.236349 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.237370 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.240950 (+ 3580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.241759 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.241986 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.247135 (+ 5149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:20.247141 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:20.247144 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:20.247180 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:20.250137 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.251240 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.251249 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.251256 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.251444 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.252157 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.252163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.252167 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.252614 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:20.252794 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:20.254788 (+ 1994us) server_negotiation.cc:299] Negotiation successful
0811 07:02:20.255019 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":294,"threads_started":1}
I20260811 07:02:20.256152 793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.230363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35667 (local address 127.30.73.66:55781)
0811 07:02:20.231336 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:20.231380 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:20.233418 (+ 2038us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:20.234265 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:20.234274 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:20.235169 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:20.236134 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.236166 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.237588 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.237596 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.240779 (+ 3183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.240797 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.242475 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.242483 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.242681 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.243665 (+ 984us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:20.243704 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:20.246883 (+ 3179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:20.250322 (+ 3439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:20.250336 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:20.250360 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:20.251056 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:20.251619 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:20.251627 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:20.251633 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:20.251970 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:20.252892 (+ 922us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:20.252904 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:20.253548 (+ 644us) client_negotiation.cc:769] Sending connection context
0811 07:02:20.254008 (+ 460us) client_negotiation.cc:240] Negotiation successful
0811 07:02:20.254768 (+ 760us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":488,"threads_started":1}
I20260811 07:02:20.279101 913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:35737 every 8 connection(s)
I20260811 07:02:20.279100 766 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:35737
I20260811 07:02:20.280854 766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:20.282140 792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.264045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:44167 (local address 127.30.73.126:35667)
0811 07:02:20.264256 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:20.264265 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:20.265569 (+ 1304us) server_negotiation.cc:407] Connection header received
0811 07:02:20.265781 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:20.265786 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:20.265885 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:20.266008 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:20.267704 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.268772 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.271249 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.271786 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.271926 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.274893 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:20.274902 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:20.274909 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:20.274958 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:20.279094 (+ 4136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.279815 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.279821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.279824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.279987 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.280342 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.280350 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.280355 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.280798 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:20.281050 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:20.281339 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 07:02:20.281631 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:02:20.282171 877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.264535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35667 (local address 127.30.73.66:44167)
0811 07:02:20.265458 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:20.265475 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:20.265648 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:20.266218 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:20.266223 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:20.266958 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:20.267472 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.267493 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.268940 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.268946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.271083 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.271105 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.272083 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.272094 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.272363 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.273063 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:20.273091 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:20.274600 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:20.279239 (+ 4639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:20.279247 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:20.279253 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:20.279694 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:20.280102 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:20.280105 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:20.280107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:20.280222 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:20.280928 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:20.280932 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:20.281091 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 07:02:20.281207 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 07:02:20.281631 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"thread_start_us":666,"threads_started":1}
I20260811 07:02:20.283349 914 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35667
I20260811 07:02:20.285336 914 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:20.286160 914 heartbeater.cc:511] Master 127.30.73.126:35667 requested a full tablet report, sending...
I20260811 07:02:20.287686 533 ts_manager.cc:194] Registered new tserver with Master: 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737)
I20260811 07:02:20.288463 533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:55781
I20260811 07:02:20.289341 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 766
I20260811 07:02:20.289521 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:20.290064 31013 external_mini_cluster.cc:1428] Setting key 3538f7d20523264fb3ad7f62a2baddf1
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:02:20.342281 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35667
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:20.697685 918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:20.698056 918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:20.698189 918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:20.705911 918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:20.706053 918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:20.706146 918 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:02:20.706218 918 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:02:20.706319 918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:20.716435 918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.73.126:35667
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:20.717707 918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:20.719024 918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:02:20.729338 762 heartbeater.cc:503] Master 127.30.73.126:35667 was elected leader, sending a full tablet report...
W20260811 07:02:20.732342 924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:20.732374 925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:20.732990 928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:20.734200 918 server_base.cc:1034] running on GCE node
I20260811 07:02:20.734817 918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:20.735882 918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:20.737130 918 hybrid_clock.cc:648] HybridClock initialized: now 1786431740737059 us; error 62 us; skew 500 ppm
I20260811 07:02:20.737535 918 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:20 dist-test-slave-69rg krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431740, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:20.741338 918 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:02:20.743162 918 webserver.cc:460] Webserver started at http://127.30.73.67:38091/ using document root <none> and password file <none>
I20260811 07:02:20.743944 918 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:20.744122 918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:20.744501 918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:20.747920 918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "24efe473d22047f48744007026d14280"
format_stamp: "Formatted at 2026-08-11 07:02:20 on dist-test-slave-69rg"
server_key: "439f6bb1f90f4ccf447cf00a594b9316"
server_key_iv: "4a36aeeedb60c8b4571b58a5706d5386"
server_key_version: "encryptionkey@0"
I20260811 07:02:20.748819 918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "24efe473d22047f48744007026d14280"
format_stamp: "Formatted at 2026-08-11 07:02:20 on dist-test-slave-69rg"
server_key: "439f6bb1f90f4ccf447cf00a594b9316"
server_key_iv: "4a36aeeedb60c8b4571b58a5706d5386"
server_key_version: "encryptionkey@0"
I20260811 07:02:20.755522 918 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 07:02:20.759859 935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:20.761365 918 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:02:20.761584 918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "24efe473d22047f48744007026d14280"
format_stamp: "Formatted at 2026-08-11 07:02:20 on dist-test-slave-69rg"
server_key: "439f6bb1f90f4ccf447cf00a594b9316"
server_key_iv: "4a36aeeedb60c8b4571b58a5706d5386"
server_key_version: "encryptionkey@0"
I20260811 07:02:20.761788 918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:20.803000 918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:20.807940 918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:20.808296 918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:20.811450 918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:20.811597 918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:20.811733 918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:20.811848 918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:02:20 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431740, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:20.840178 946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.811987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:45723 (local address 127.30.73.126:35667)
0811 07:02:20.814993 (+ 3006us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:20.814998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:20.815018 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:02:20.817896 (+ 2878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:20.817905 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:20.818015 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:20.818133 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:20.821256 (+ 3123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.822392 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.825560 (+ 3168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.826244 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.826391 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.831392 (+ 5001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:20.831398 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:20.831401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:20.831435 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:20.835301 (+ 3866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.836597 (+ 1296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.836605 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.836609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.836853 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.837495 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.837503 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.837509 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.838042 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:20.838228 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:20.839187 (+ 959us) server_negotiation.cc:299] Negotiation successful
0811 07:02:20.839533 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2894,"thread_start_us":2777,"threads_started":1}
I20260811 07:02:20.840772 947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.812827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35667 (local address 127.30.73.67:45723)
0811 07:02:20.813964 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:20.814014 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:20.817420 (+ 3406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:20.818527 (+ 1107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:20.818542 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:20.819776 (+ 1234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:20.820979 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.821034 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.822640 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.822647 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.825376 (+ 2729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.825394 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.826508 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.826516 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.826796 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.827667 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:20.827690 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:20.831069 (+ 3379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:20.835505 (+ 4436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:20.835518 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:20.835550 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:20.836445 (+ 895us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:20.837009 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:20.837013 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:20.837015 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:20.837331 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:20.838256 (+ 925us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:20.838267 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:20.838698 (+ 431us) client_negotiation.cc:769] Sending connection context
0811 07:02:20.838968 (+ 270us) client_negotiation.cc:240] Negotiation successful
0811 07:02:20.839428 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"thread_start_us":506,"threads_started":1}
I20260811 07:02:20.866649 918 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:41227
I20260811 07:02:20.866684 1073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:41227 every 8 connection(s)
I20260811 07:02:20.867444 1029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.848668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35667 (local address 127.30.73.67:52337)
0811 07:02:20.849406 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:20.849438 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:20.849593 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:20.850068 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:20.850080 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:20.850941 (+ 861us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:20.851467 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.851488 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.853230 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.853238 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.855423 (+ 2185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.855439 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.856340 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.856349 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.856520 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.857355 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:20.857375 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:20.858557 (+ 1182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:20.863636 (+ 5079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:20.863642 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:20.863646 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:20.864406 (+ 760us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:20.864874 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:20.864880 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:20.864884 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:20.865031 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:20.865976 (+ 945us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:20.865981 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:20.866216 (+ 235us) client_negotiation.cc:769] Sending connection context
0811 07:02:20.866393 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 07:02:20.866888 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":386,"threads_started":1}
I20260811 07:02:20.867641 946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.848574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:52337 (local address 127.30.73.126:35667)
0811 07:02:20.848821 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:20.848831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:20.849561 (+ 730us) server_negotiation.cc:407] Connection header received
0811 07:02:20.849726 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:20.849734 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:20.849864 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:20.850011 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:20.851662 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.852969 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.855593 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.856087 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.856249 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.858838 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:20.858843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:20.858846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:20.858882 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:20.863427 (+ 4545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.864557 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.864567 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.864571 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.864740 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.865164 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.865171 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.865175 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.865756 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:20.866007 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:20.866497 (+ 490us) server_negotiation.cc:299] Negotiation successful
0811 07:02:20.867004 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:02:20.868284 918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:20.870910 1074 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35667
I20260811 07:02:20.871237 1074 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:20.872126 1074 heartbeater.cc:511] Master 127.30.73.126:35667 requested a full tablet report, sending...
I20260811 07:02:20.873488 533 ts_manager.cc:194] Registered new tserver with Master: 24efe473d22047f48744007026d14280 (127.30.73.67:41227)
I20260811 07:02:20.874459 533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:45723
I20260811 07:02:20.877985 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 918
I20260811 07:02:20.878190 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:20.878661 31013 external_mini_cluster.cc:1428] Setting key 69b5419bd32566e56e56da207361b93c
I20260811 07:02:20.881971 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:02:20 dist-test-slave-69rg krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:02:20 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:20.938963 946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.923329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58028 (local address 127.30.73.126:35667)
0811 07:02:20.923535 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:20.923541 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:20.923826 (+ 285us) server_negotiation.cc:407] Connection header received
0811 07:02:20.923995 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:20.923999 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:20.924070 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:20.924168 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:20.925653 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.926559 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.928030 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.928494 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.928647 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.933089 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:20.933094 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:20.933097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:20.933133 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:20.936194 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.936882 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.936889 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.936892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.937032 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:20.937431 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:20.937436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:20.937441 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:20.937731 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:20.938027 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:20.938378 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 07:02:20.938614 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:02:20.943389 533 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:02:20.950428 533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:20.974680 1089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.963500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:32943 (local address 127.0.0.1:49580)
0811 07:02:20.964304 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:20.964362 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:20.964559 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:20.966068 (+ 1509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:20.966078 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:20.966110 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:20.966782 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.966800 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.969348 (+ 2548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.969356 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.971725 (+ 2369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.971741 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.973586 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.973594 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.973856 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.973915 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 07:02:20.974054 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 07:02:20.974281 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":305,"threads_started":1}
I20260811 07:02:20.975190 1091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.963825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49580 (local address 127.30.73.65:32943)
0811 07:02:20.965244 (+ 1419us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:20.965256 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:20.965292 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:02:20.965410 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:20.965421 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:20.965752 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:20.966027 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:20.967058 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.969114 (+ 2056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.971932 (+ 2818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.973359 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.973529 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.973776 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:20.974115 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 07:02:20.974295 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1238,"thread_start_us":1104,"threads_started":1}
I20260811 07:02:20.975929 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.963797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:35737 (local address 127.0.0.1:49968)
0811 07:02:20.967066 (+ 3269us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:20.967092 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:20.967224 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:20.968866 (+ 1642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:20.968873 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:20.968908 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:20.969358 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.969372 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.971290 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.971295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.972974 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.972986 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.975036 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.975042 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.975256 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.975304 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 07:02:20.975392 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:02:20.975520 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2993,"mutex_wait_us":22,"thread_start_us":2822,"threads_started":1}
I20260811 07:02:20.976161 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.964316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49968 (local address 127.30.73.66:35737)
0811 07:02:20.964833 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:20.964841 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:20.967205 (+ 2364us) server_negotiation.cc:407] Connection header received
0811 07:02:20.968333 (+ 1128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:20.968342 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:20.968628 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:20.969574 (+ 946us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:20.969811 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.971090 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.973200 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.974682 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.975241 (+ 559us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.975520 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:20.975592 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 07:02:20.975759 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":245,"threads_started":1}
I20260811 07:02:20.979668 1093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.967428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41227 (local address 127.0.0.1:44082)
0811 07:02:20.967988 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:20.968010 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:20.968119 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:20.969918 (+ 1799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:20.969923 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:20.969951 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:20.970405 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.970418 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.973090 (+ 2672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.973095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.976190 (+ 3095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:20.976207 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.978872 (+ 2665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.978880 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:20.979046 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.979079 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:02:20.979177 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 07:02:20.979319 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":1,"thread_start_us":310,"threads_started":1}
I20260811 07:02:20.979871 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:20.967492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44082 (local address 127.30.73.67:41227)
0811 07:02:20.969283 (+ 1791us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:20.969293 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:20.969328 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:02:20.969427 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:20.969444 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:20.969671 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:20.969901 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:20.970664 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.972937 (+ 2273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.977115 (+ 4178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:20.978652 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:20.978797 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:20.979019 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:20.979236 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 07:02:20.979417 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1586,"thread_start_us":1366,"threads_started":1}
I20260811 07:02:20.979293 838 tablet_service.cc:1467] Processing CreateTablet for tablet c175dc89ec094432b7c27bfe3bec18d1 (DEFAULT_TABLE table=test-table [id=2878bcaf456148a6b6a40d387bb012bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:20.979375 681 tablet_service.cc:1467] Processing CreateTablet for tablet c175dc89ec094432b7c27bfe3bec18d1 (DEFAULT_TABLE table=test-table [id=2878bcaf456148a6b6a40d387bb012bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:20.980883 838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c175dc89ec094432b7c27bfe3bec18d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:20.981236 681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c175dc89ec094432b7c27bfe3bec18d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:20.983563 993 tablet_service.cc:1467] Processing CreateTablet for tablet c175dc89ec094432b7c27bfe3bec18d1 (DEFAULT_TABLE table=test-table [id=2878bcaf456148a6b6a40d387bb012bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:20.984958 993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c175dc89ec094432b7c27bfe3bec18d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:20.993718 1095 tablet_bootstrap.cc:492] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: Bootstrap starting.
I20260811 07:02:20.996063 1096 tablet_bootstrap.cc:492] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: Bootstrap starting.
I20260811 07:02:20.997642 1095 tablet_bootstrap.cc:654] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:20.999024 1095 log.cc:824] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:20.999730 1096 tablet_bootstrap.cc:654] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:21.001293 1096 log.cc:824] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:21.006214 1097 tablet_bootstrap.cc:492] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: Bootstrap starting.
I20260811 07:02:21.010536 1097 tablet_bootstrap.cc:654] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:21.011463 1095 tablet_bootstrap.cc:492] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: No bootstrap required, opened a new log
I20260811 07:02:21.011790 1096 tablet_bootstrap.cc:492] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: No bootstrap required, opened a new log
I20260811 07:02:21.011816 1095 ts_tablet_manager.cc:1397] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20260811 07:02:21.012101 1096 ts_tablet_manager.cc:1397] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.008s
I20260811 07:02:21.012084 1097 log.cc:824] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:21.015216 1097 tablet_bootstrap.cc:492] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: No bootstrap required, opened a new log
I20260811 07:02:21.015523 1097 ts_tablet_manager.cc:1397] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260811 07:02:21.023739 1097 raft_consensus.cc:348] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.023782 1095 raft_consensus.cc:348] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.024194 1097 raft_consensus.cc:374] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:21.024282 1095 raft_consensus.cc:374] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:21.024284 1097 raft_consensus.cc:729] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24efe473d22047f48744007026d14280, State: Initialized, Role: FOLLOWER
I20260811 07:02:21.024400 1095 raft_consensus.cc:729] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17753be418ba4ee8bd2bf858347a6ac1, State: Initialized, Role: FOLLOWER
I20260811 07:02:21.024101 1096 raft_consensus.cc:348] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.024572 1096 raft_consensus.cc:374] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:21.024688 1096 raft_consensus.cc:729] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aa696c61e1411c8bd95988c3396b5b, State: Initialized, Role: FOLLOWER
I20260811 07:02:21.025041 1097 consensus_queue.cc:260] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.025161 1095 consensus_queue.cc:260] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.025245 1096 consensus_queue.cc:260] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.026335 1074 heartbeater.cc:503] Master 127.30.73.126:35667 was elected leader, sending a full tablet report...
I20260811 07:02:21.027117 1097 ts_tablet_manager.cc:1428] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260811 07:02:21.030799 1096 ts_tablet_manager.cc:1428] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: Time spent starting tablet: real 0.019s user 0.014s sys 0.005s
I20260811 07:02:21.032018 914 heartbeater.cc:503] Master 127.30.73.126:35667 was elected leader, sending a full tablet report...
I20260811 07:02:21.032861 1095 ts_tablet_manager.cc:1428] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent starting tablet: real 0.021s user 0.014s sys 0.007s
W20260811 07:02:21.034204 915 tablet.cc:2369] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:02:21.062388 1102 raft_consensus.cc:482] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:21.062772 1102 raft_consensus.cc:504] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.064535 1102 leader_election.cc:288] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943), 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737)
I20260811 07:02:21.071372 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.065081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:59681 (local address 127.30.73.66:35737)
0811 07:02:21.065267 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.065273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.065595 (+ 322us) server_negotiation.cc:407] Connection header received
0811 07:02:21.065666 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.065670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.065729 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.065865 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:21.066309 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.067276 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.069356 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.070497 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.070718 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.070797 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.071054 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.071165 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:02:21.071442 947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.065130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:35737 (local address 127.30.73.67:59681)
0811 07:02:21.065319 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:21.065340 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:21.065489 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:21.065882 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:21.065887 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:21.065921 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:21.066140 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.066149 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.067439 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.067443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.069140 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.069159 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.070687 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.070693 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.070878 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.070914 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:02:21.071016 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 07:02:21.071168 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 07:02:21.072533 1091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.065004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:49779 (local address 127.30.73.65:32943)
0811 07:02:21.065257 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.065264 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.066300 (+ 1036us) server_negotiation.cc:407] Connection header received
0811 07:02:21.066574 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.066580 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.066668 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.066774 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:21.067408 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.068105 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.070282 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.071434 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.071619 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.071710 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.072149 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.072279 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 07:02:21.072616 1106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.065130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:32943 (local address 127.30.73.67:49779)
0811 07:02:21.066188 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:21.066203 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:21.066359 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:21.066828 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:21.066832 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:21.066855 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:21.067230 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.067241 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.068255 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.068261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.070103 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.070123 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.071823 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.071828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.071967 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.071990 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 07:02:21.072110 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 07:02:21.072240 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"mutex_wait_us":193,"thread_start_us":454,"threads_started":1}
I20260811 07:02:21.072481 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c175dc89ec094432b7c27bfe3bec18d1" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17753be418ba4ee8bd2bf858347a6ac1" is_pre_election: true
I20260811 07:02:21.073100 864 raft_consensus.cc:2454] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 0.
I20260811 07:02:21.073594 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c175dc89ec094432b7c27bfe3bec18d1" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aa696c61e1411c8bd95988c3396b5b" is_pre_election: true
I20260811 07:02:21.074002 937 leader_election.cc:302] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17753be418ba4ee8bd2bf858347a6ac1, 24efe473d22047f48744007026d14280; no voters:
I20260811 07:02:21.074220 706 raft_consensus.cc:2454] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 0.
I20260811 07:02:21.074461 1102 raft_consensus.cc:2781] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:21.074648 1102 raft_consensus.cc:482] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:21.074792 1102 raft_consensus.cc:3037] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:21.077138 1102 raft_consensus.cc:504] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.077780 1102 leader_election.cc:288] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 election: Requested vote from peers 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943), 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737)
I20260811 07:02:21.078311 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c175dc89ec094432b7c27bfe3bec18d1" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17753be418ba4ee8bd2bf858347a6ac1"
I20260811 07:02:21.078424 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c175dc89ec094432b7c27bfe3bec18d1" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aa696c61e1411c8bd95988c3396b5b"
I20260811 07:02:21.078522 864 raft_consensus.cc:3037] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:21.078696 706 raft_consensus.cc:3037] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:21.080755 864 raft_consensus.cc:2454] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 1.
I20260811 07:02:21.080951 706 raft_consensus.cc:2454] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 1.
I20260811 07:02:21.081159 937 leader_election.cc:302] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17753be418ba4ee8bd2bf858347a6ac1, 24efe473d22047f48744007026d14280; no voters:
I20260811 07:02:21.081488 1102 raft_consensus.cc:2781] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:21.082024 1102 raft_consensus.cc:686] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 1 LEADER]: Becoming Leader. State: Replica: 24efe473d22047f48744007026d14280, State: Running, Role: LEADER
I20260811 07:02:21.082510 1102 consensus_queue.cc:237] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.087549 532 catalog_manager.cc:5495] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24efe473d22047f48744007026d14280 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } health_report { overall_health: HEALTHY } } }
W20260811 07:02:21.120438 1076 tablet.cc:2369] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 07:02:21 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431738, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:21.136258 1114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.120721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35667 (local address 127.0.0.1:58030)
0811 07:02:21.121348 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:21.121364 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:21.121491 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:21.121911 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:21.121915 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:21.122590 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:21.122862 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.122871 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.124017 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.124021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.125054 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.125067 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.125971 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.125980 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.126170 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.126870 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:21.126891 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:21.129370 (+ 2479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:21.133526 (+ 4156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:21.133543 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:21.133550 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:21.134180 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:21.134579 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:21.134583 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:21.134585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:21.134722 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:21.135260 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:21.135266 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:21.135458 (+ 192us) client_negotiation.cc:769] Sending connection context
0811 07:02:21.135597 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 07:02:21.135829 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":351,"threads_started":1}
I20260811 07:02:21.136294 946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.120555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58030 (local address 127.30.73.126:35667)
0811 07:02:21.120803 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.120808 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.121456 (+ 648us) server_negotiation.cc:407] Connection header received
0811 07:02:21.121650 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.121654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.121715 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.121800 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:21.123033 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.123838 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.125206 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.125688 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.125787 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.129589 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:21.129594 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:21.129597 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:21.129630 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:21.133341 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:21.134317 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:21.134322 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:21.134324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:21.134468 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:21.134837 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:21.134841 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:21.134843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:21.135135 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:21.135258 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.135713 (+ 455us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.135962 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":124}
I20260811 07:02:21.141804 532 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:58030:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:02:21.142910 532 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:21.149924 681 tablet_service.cc:1467] Processing CreateTablet for tablet 7e42c2d6618c412880ea15f2974b79b0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e7a933798eb24c689d29a2d0daabbaca]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:02:21.150030 838 tablet_service.cc:1467] Processing CreateTablet for tablet 7e42c2d6618c412880ea15f2974b79b0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e7a933798eb24c689d29a2d0daabbaca]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:02:21.150274 993 tablet_service.cc:1467] Processing CreateTablet for tablet 7e42c2d6618c412880ea15f2974b79b0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e7a933798eb24c689d29a2d0daabbaca]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:02:21.150940 681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e42c2d6618c412880ea15f2974b79b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:21.150975 838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e42c2d6618c412880ea15f2974b79b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:21.151042 993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e42c2d6618c412880ea15f2974b79b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:21.157006 1096 tablet_bootstrap.cc:492] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: Bootstrap starting.
I20260811 07:02:21.158357 1097 tablet_bootstrap.cc:492] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: Bootstrap starting.
I20260811 07:02:21.158674 1096 tablet_bootstrap.cc:654] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:21.158915 1095 tablet_bootstrap.cc:492] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: Bootstrap starting.
I20260811 07:02:21.160312 1097 tablet_bootstrap.cc:654] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:21.160753 1095 tablet_bootstrap.cc:654] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:21.162297 1096 tablet_bootstrap.cc:492] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: No bootstrap required, opened a new log
I20260811 07:02:21.162500 1096 ts_tablet_manager.cc:1397] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:02:21.163439 1095 tablet_bootstrap.cc:492] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: No bootstrap required, opened a new log
I20260811 07:02:21.163587 1095 ts_tablet_manager.cc:1397] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260811 07:02:21.163539 1096 raft_consensus.cc:348] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.163887 1096 raft_consensus.cc:374] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:21.164011 1096 raft_consensus.cc:729] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aa696c61e1411c8bd95988c3396b5b, State: Initialized, Role: FOLLOWER
I20260811 07:02:21.164286 1096 consensus_queue.cc:260] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.164366 1095 raft_consensus.cc:348] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.164602 1095 raft_consensus.cc:374] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:21.164697 1095 raft_consensus.cc:729] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17753be418ba4ee8bd2bf858347a6ac1, State: Initialized, Role: FOLLOWER
I20260811 07:02:21.164959 1095 consensus_queue.cc:260] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.164888 1105 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.165351 1105 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:21.165616 1095 ts_tablet_manager.cc:1428] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:02:21.166043 1104 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.166435 1104 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:21.166960 1096 ts_tablet_manager.cc:1428] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 07:02:21.168743 1097 tablet_bootstrap.cc:492] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: No bootstrap required, opened a new log
I20260811 07:02:21.168897 1097 ts_tablet_manager.cc:1397] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260811 07:02:21.169785 1097 raft_consensus.cc:348] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.170102 1097 raft_consensus.cc:374] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:21.170230 1097 raft_consensus.cc:729] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24efe473d22047f48744007026d14280, State: Initialized, Role: FOLLOWER
I20260811 07:02:21.170481 1097 consensus_queue.cc:260] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.171067 1097 ts_tablet_manager.cc:1428] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:02:21.170920 1102 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.171267 1102 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 07:02:21.219590 763 tablet.cc:2369] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:02:21.232890 1102 raft_consensus.cc:482] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:21.233100 1102 raft_consensus.cc:504] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.233803 1102 leader_election.cc:288] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943), 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737)
I20260811 07:02:21.234337 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e42c2d6618c412880ea15f2974b79b0" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aa696c61e1411c8bd95988c3396b5b" is_pre_election: true
I20260811 07:02:21.234513 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e42c2d6618c412880ea15f2974b79b0" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17753be418ba4ee8bd2bf858347a6ac1" is_pre_election: true
I20260811 07:02:21.234632 706 raft_consensus.cc:2454] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 0.
I20260811 07:02:21.234827 864 raft_consensus.cc:2454] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 0.
I20260811 07:02:21.235110 940 leader_election.cc:302] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aa696c61e1411c8bd95988c3396b5b, 24efe473d22047f48744007026d14280; no voters:
I20260811 07:02:21.235446 1102 raft_consensus.cc:2781] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:21.235556 1102 raft_consensus.cc:482] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:21.235685 1102 raft_consensus.cc:3037] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:21.237783 1102 raft_consensus.cc:504] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.238420 1102 leader_election.cc:288] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 election: Requested vote from peers 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943), 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737)
I20260811 07:02:21.238933 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e42c2d6618c412880ea15f2974b79b0" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aa696c61e1411c8bd95988c3396b5b"
I20260811 07:02:21.239004 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e42c2d6618c412880ea15f2974b79b0" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17753be418ba4ee8bd2bf858347a6ac1"
I20260811 07:02:21.239194 706 raft_consensus.cc:3037] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:21.239274 864 raft_consensus.cc:3037] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:21.241315 706 raft_consensus.cc:2454] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 1.
I20260811 07:02:21.241393 864 raft_consensus.cc:2454] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 1.
I20260811 07:02:21.241775 940 leader_election.cc:302] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aa696c61e1411c8bd95988c3396b5b, 24efe473d22047f48744007026d14280; no voters:
I20260811 07:02:21.242067 1102 raft_consensus.cc:2781] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:21.242260 1102 raft_consensus.cc:686] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [term 1 LEADER]: Becoming Leader. State: Replica: 24efe473d22047f48744007026d14280, State: Running, Role: LEADER
I20260811 07:02:21.242822 1102 consensus_queue.cc:237] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.244583 1107 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: TxnStatusTablet state changed. Reason: New leader 24efe473d22047f48744007026d14280. Latest consensus state: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.245004 1107 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:02:21.245995 1120 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:02:21.246310 1120 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:02:21.246838 533 catalog_manager.cc:5495] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24efe473d22047f48744007026d14280 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260811 07:02:21.266047 1114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.259300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41227 (local address 127.0.0.1:44090)
0811 07:02:21.259555 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:21.259579 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:21.259728 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:21.260256 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:21.260260 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:21.260272 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:02:21.260443 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.260450 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.261966 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.261971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.263214 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.263228 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.264234 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.264239 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.264373 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.264434 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.265488 (+ 1054us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.265517 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:02:21.265589 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 07:02:21.265712 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 07:02:21.266067 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.259295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44090 (local address 127.30.73.67:41227)
0811 07:02:21.259552 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.259558 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.259666 (+ 108us) server_negotiation.cc:407] Connection header received
0811 07:02:21.259917 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.259922 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.260049 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.260205 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:21.260593 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.261786 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.263351 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.264054 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.264189 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.264637 (+ 448us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.265344 (+ 707us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.265511 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.265616 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.265704 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260811 07:02:21.274385 706 raft_consensus.cc:1261] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Refusing update from remote peer 24efe473d22047f48744007026d14280: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:21.274385 864 raft_consensus.cc:1261] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Refusing update from remote peer 24efe473d22047f48744007026d14280: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:21.275465 1107 consensus_queue.cc:1035] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:21.275844 1102 consensus_queue.cc:1035] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:21.283803 1105 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: TxnStatusTablet state changed. Reason: New leader 24efe473d22047f48744007026d14280. Latest consensus state: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.284137 1105 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:21.287653 1123 mvcc.cc:205] Tried to move back new op lower bound from 7317224412249489408 to 7317224412132708352. Current Snapshot: MvccSnapshot[applied={T|T < 7317224412249489408}]
I20260811 07:02:21.304837 1105 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.305152 1105 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 17aa696c61e1411c8bd95988c3396b5b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:21.314939 1107 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.315310 1107 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:02:21.318902 1104 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: TxnStatusTablet state changed. Reason: New leader 24efe473d22047f48744007026d14280. Latest consensus state: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.319243 1104 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:21.326038 1102 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.326540 1102 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 24efe473d22047f48744007026d14280: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:02:21.332281 1125 mvcc.cc:205] Tried to move back new op lower bound from 7317224412249489408 to 7317224412132708352. Current Snapshot: MvccSnapshot[applied={T|T < 7317224412249489408}]
I20260811 07:02:21.341003 1104 tablet_replica.cc:439] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } } }
I20260811 07:02:21.341320 1104 tablet_replica.cc:442] T 7e42c2d6618c412880ea15f2974b79b0 P 17753be418ba4ee8bd2bf858347a6ac1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:02:21.346897 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.340140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44104 (local address 127.30.73.67:41227)
0811 07:02:21.340343 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.340352 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.340374 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:02:21.340451 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.340456 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.340544 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.340631 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:21.341270 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.342527 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.344627 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.345208 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.345378 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.345942 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.346112 (+ 170us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.346182 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.346404 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.346525 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:02:21.366258 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.359410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:35721 (local address 127.30.73.67:41227)
0811 07:02:21.359681 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.359690 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.360104 (+ 414us) server_negotiation.cc:407] Connection header received
0811 07:02:21.360345 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.360349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.360418 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.360495 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:21.361007 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.361792 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.364037 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.364520 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.364627 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.365316 (+ 689us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.365570 (+ 254us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.365663 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.365911 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.365985 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 07:02:21.366592 1029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.359615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41227 (local address 127.30.73.67:35721)
0811 07:02:21.359932 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:21.359958 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:21.360168 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:21.360562 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:21.360567 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:21.360582 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:02:21.360809 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.360822 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.362030 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.362036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.363846 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.363868 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.364699 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.364706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.364894 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.364990 (+ 96us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.365693 (+ 703us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.365712 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 07:02:21.365836 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 07:02:21.366015 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 07:02:21.378082 706 raft_consensus.cc:1261] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Refusing update from remote peer 24efe473d22047f48744007026d14280: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:21.378082 864 raft_consensus.cc:1261] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Refusing update from remote peer 24efe473d22047f48744007026d14280: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:21.378718 1107 consensus_queue.cc:1035] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:21.379022 1130 consensus_queue.cc:1035] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:21.482825 533 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:21.483121 533 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:21.486562 533 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943: Sending DeleteTablet for 3 replicas of tablet c175dc89ec094432b7c27bfe3bec18d1
I20260811 07:02:21.487798 681 tablet_service.cc:1514] Processing DeleteTablet for tablet c175dc89ec094432b7c27bfe3bec18d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:21 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:49580
I20260811 07:02:21.488322 838 tablet_service.cc:1514] Processing DeleteTablet for tablet c175dc89ec094432b7c27bfe3bec18d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:21 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:49968
I20260811 07:02:21.489770 993 tablet_service.cc:1514] Processing DeleteTablet for tablet c175dc89ec094432b7c27bfe3bec18d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:21 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:44082
I20260811 07:02:21.496520 533 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:02:21.497555 533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:21.499266 1141 tablet_replica.cc:330] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: stopping tablet replica
I20260811 07:02:21.500164 1141 raft_consensus.cc:2229] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:21.500784 1141 raft_consensus.cc:2258] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:21.504276 1141 ts_tablet_manager.cc:1905] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:21.512938 1141 ts_tablet_manager.cc:1918] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:02:21.513283 1141 log.cc:1196] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/c175dc89ec094432b7c27bfe3bec18d1
I20260811 07:02:21.514070 1141 ts_tablet_manager.cc:1939] T c175dc89ec094432b7c27bfe3bec18d1 P 17aa696c61e1411c8bd95988c3396b5b: Deleting consensus metadata
I20260811 07:02:21.515561 681 tablet_service.cc:1467] Processing CreateTablet for tablet 4968dbc223fa496b88702ccf17c2c4c4 (DEFAULT_TABLE table=test-table [id=2b887980b00e4b7d9458fcb74f93dc06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:21.516176 681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4968dbc223fa496b88702ccf17c2c4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:21.516222 836 tablet_service.cc:1467] Processing CreateTablet for tablet 4968dbc223fa496b88702ccf17c2c4c4 (DEFAULT_TABLE table=test-table [id=2b887980b00e4b7d9458fcb74f93dc06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:21.516477 992 tablet_service.cc:1467] Processing CreateTablet for tablet 4968dbc223fa496b88702ccf17c2c4c4 (DEFAULT_TABLE table=test-table [id=2b887980b00e4b7d9458fcb74f93dc06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:21.516719 836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4968dbc223fa496b88702ccf17c2c4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:21.517019 992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4968dbc223fa496b88702ccf17c2c4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:21.523518 1096 tablet_bootstrap.cc:492] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: Bootstrap starting.
I20260811 07:02:21.523614 1095 tablet_bootstrap.cc:492] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: Bootstrap starting.
I20260811 07:02:21.524945 1097 tablet_bootstrap.cc:492] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: Bootstrap starting.
I20260811 07:02:21.525390 1095 tablet_bootstrap.cc:654] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:21.525411 1096 tablet_bootstrap.cc:654] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:21.526849 1097 tablet_bootstrap.cc:654] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:21.532039 518 catalog_manager.cc:4841] TS 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943): tablet c175dc89ec094432b7c27bfe3bec18d1 (table test-table [id=2878bcaf456148a6b6a40d387bb012bd]) successfully deleted
I20260811 07:02:21.537251 1096 tablet_bootstrap.cc:492] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: No bootstrap required, opened a new log
I20260811 07:02:21.537617 1096 ts_tablet_manager.cc:1397] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260811 07:02:21.538940 1096 raft_consensus.cc:348] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.539507 1096 raft_consensus.cc:374] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:21.539676 1096 raft_consensus.cc:729] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aa696c61e1411c8bd95988c3396b5b, State: Initialized, Role: FOLLOWER
I20260811 07:02:21.540130 1096 consensus_queue.cc:260] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.541031 1096 ts_tablet_manager.cc:1428] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:02:21.544730 1095 tablet_bootstrap.cc:492] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: No bootstrap required, opened a new log
I20260811 07:02:21.544996 1095 ts_tablet_manager.cc:1397] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.001s
I20260811 07:02:21.545869 1095 raft_consensus.cc:348] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.546141 1095 raft_consensus.cc:374] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:21.546221 1095 raft_consensus.cc:729] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17753be418ba4ee8bd2bf858347a6ac1, State: Initialized, Role: FOLLOWER
I20260811 07:02:21.546489 1095 consensus_queue.cc:260] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.547242 1095 ts_tablet_manager.cc:1428] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 07:02:21.550577 1105 raft_consensus.cc:482] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:21.550820 1105 raft_consensus.cc:504] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.552994 1105 leader_election.cc:288] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737), 24efe473d22047f48744007026d14280 (127.30.73.67:41227)
I20260811 07:02:21.553524 1142 tablet_replica.cc:330] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: stopping tablet replica
I20260811 07:02:21.554100 1142 raft_consensus.cc:2229] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:21.554556 1143 tablet_replica.cc:330] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: stopping tablet replica
I20260811 07:02:21.554682 1142 raft_consensus.cc:2258] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:21.554986 1143 raft_consensus.cc:2229] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:02:21.555660 1143 raft_consensus.cc:2258] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:21.558414 1142 ts_tablet_manager.cc:1905] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:21.561025 1097 tablet_bootstrap.cc:492] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: No bootstrap required, opened a new log
I20260811 07:02:21.561244 1097 ts_tablet_manager.cc:1397] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.008s
I20260811 07:02:21.562326 1097 raft_consensus.cc:348] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.562633 1097 raft_consensus.cc:374] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:21.562728 1097 raft_consensus.cc:729] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24efe473d22047f48744007026d14280, State: Initialized, Role: FOLLOWER
I20260811 07:02:21.563045 1097 consensus_queue.cc:260] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.558589 1143 ts_tablet_manager.cc:1905] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:21.568112 1097 ts_tablet_manager.cc:1428] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 07:02:21.590603 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.554260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:52815 (local address 127.30.73.66:35737)
0811 07:02:21.554576 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.554583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.578995 (+ 24412us) server_negotiation.cc:407] Connection header received
0811 07:02:21.580692 (+ 1697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.580702 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.580812 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.580888 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:21.582268 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.583399 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.588349 (+ 4950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.589468 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.589667 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.589744 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.590162 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.590305 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 07:02:21.591732 1149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.553705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:35737 (local address 127.30.73.65:52815)
0811 07:02:21.578840 (+ 25135us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:21.578868 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:21.580438 (+ 1570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:21.581185 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:21.581193 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:21.581225 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:21.581521 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.581537 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.583617 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.583622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.585705 (+ 2083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.585730 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.589668 (+ 3938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.589675 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.589952 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.589989 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:02:21.591155 (+ 1166us) client_negotiation.cc:240] Negotiation successful
0811 07:02:21.591324 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24948,"thread_start_us":25322,"threads_started":1}
I20260811 07:02:21.592664 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4968dbc223fa496b88702ccf17c2c4c4" candidate_uuid: "17aa696c61e1411c8bd95988c3396b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17753be418ba4ee8bd2bf858347a6ac1" is_pre_election: true
I20260811 07:02:21.592971 864 raft_consensus.cc:2454] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aa696c61e1411c8bd95988c3396b5b in term 0.
I20260811 07:02:21.593647 628 leader_election.cc:302] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17753be418ba4ee8bd2bf858347a6ac1, 17aa696c61e1411c8bd95988c3396b5b; no voters:
I20260811 07:02:21.594201 1105 raft_consensus.cc:2781] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:21.594331 1105 raft_consensus.cc:482] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:21.594442 1105 raft_consensus.cc:3037] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:21.588666 1142 ts_tablet_manager.cc:1918] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:02:21.596069 1142 log.cc:1196] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/c175dc89ec094432b7c27bfe3bec18d1
I20260811 07:02:21.596663 1142 ts_tablet_manager.cc:1939] T c175dc89ec094432b7c27bfe3bec18d1 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting consensus metadata
I20260811 07:02:21.598106 1105 raft_consensus.cc:504] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.598848 1105 leader_election.cc:288] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [CANDIDATE]: Term 1 election: Requested vote from peers 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737), 24efe473d22047f48744007026d14280 (127.30.73.67:41227)
I20260811 07:02:21.599314 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4968dbc223fa496b88702ccf17c2c4c4" candidate_uuid: "17aa696c61e1411c8bd95988c3396b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17753be418ba4ee8bd2bf858347a6ac1"
I20260811 07:02:21.599522 864 raft_consensus.cc:3037] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:21.602734 864 raft_consensus.cc:2454] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aa696c61e1411c8bd95988c3396b5b in term 1.
I20260811 07:02:21.603344 628 leader_election.cc:302] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17753be418ba4ee8bd2bf858347a6ac1, 17aa696c61e1411c8bd95988c3396b5b; no voters:
I20260811 07:02:21.603660 1105 raft_consensus.cc:2781] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:21.606329 515 catalog_manager.cc:4841] TS 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737): tablet c175dc89ec094432b7c27bfe3bec18d1 (table test-table [id=2878bcaf456148a6b6a40d387bb012bd]) successfully deleted
I20260811 07:02:21.608997 1143 ts_tablet_manager.cc:1918] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:02:21.615160 1149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.580153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41227 (local address 127.30.73.65:54793)
0811 07:02:21.592749 (+ 12596us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:21.592770 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:21.593059 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:21.599805 (+ 6746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:21.599812 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:21.599848 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:21.602185 (+ 2337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.602202 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.603946 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.603953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.610729 (+ 6776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.610759 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.613572 (+ 2813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.613577 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.613784 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.613851 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 07:02:21.614603 (+ 752us) client_negotiation.cc:240] Negotiation successful
0811 07:02:21.614792 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12429,"thread_start_us":8722,"threads_started":1}
I20260811 07:02:21.614522 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.579710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:54793 (local address 127.30.73.67:41227)
0811 07:02:21.579975 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.579983 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.592848 (+ 12865us) server_negotiation.cc:407] Connection header received
0811 07:02:21.593340 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.593345 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.593427 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.593497 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:21.602397 (+ 8900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.603561 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.611021 (+ 7460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.613055 (+ 2034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.613248 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.613371 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.614040 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.614195 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 07:02:21.616225 1143 log.cc:1196] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/c175dc89ec094432b7c27bfe3bec18d1
I20260811 07:02:21.617206 1143 ts_tablet_manager.cc:1939] T c175dc89ec094432b7c27bfe3bec18d1 P 24efe473d22047f48744007026d14280: Deleting consensus metadata
I20260811 07:02:21.618659 1022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4968dbc223fa496b88702ccf17c2c4c4" candidate_uuid: "17aa696c61e1411c8bd95988c3396b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24efe473d22047f48744007026d14280" is_pre_election: true
I20260811 07:02:21.619154 1022 raft_consensus.cc:2454] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aa696c61e1411c8bd95988c3396b5b in term 0.
I20260811 07:02:21.619689 1021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4968dbc223fa496b88702ccf17c2c4c4" candidate_uuid: "17aa696c61e1411c8bd95988c3396b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24efe473d22047f48744007026d14280"
I20260811 07:02:21.619802 515 catalog_manager.cc:4841] TS 24efe473d22047f48744007026d14280 (127.30.73.67:41227): tablet c175dc89ec094432b7c27bfe3bec18d1 (table test-table [id=2878bcaf456148a6b6a40d387bb012bd]) successfully deleted
I20260811 07:02:21.619900 1021 raft_consensus.cc:3037] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:21.624980 1021 raft_consensus.cc:2454] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aa696c61e1411c8bd95988c3396b5b in term 1.
I20260811 07:02:21.625353 1105 raft_consensus.cc:686] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 1 LEADER]: Becoming Leader. State: Replica: 17aa696c61e1411c8bd95988c3396b5b, State: Running, Role: LEADER
I20260811 07:02:21.625877 1105 consensus_queue.cc:237] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:21.630076 533 catalog_manager.cc:5495] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65). New cstate: current_term: 1 leader_uuid: "17aa696c61e1411c8bd95988c3396b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260811 07:02:21.702811 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.676026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49592 (local address 127.30.73.65:32943)
0811 07:02:21.692652 (+ 16626us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.692662 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.692705 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:02:21.692856 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.692864 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.693005 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.694017 (+ 1012us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:21.694389 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.695782 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.698331 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.699167 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.699881 (+ 714us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.700090 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.701072 (+ 982us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.702092 (+ 1020us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.702173 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.702285 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16368,"thread_start_us":17200,"threads_started":1}
I20260811 07:02:21.752422 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.732638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:34585 (local address 127.30.73.67:41227)
0811 07:02:21.732877 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.732891 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.742844 (+ 9953us) server_negotiation.cc:407] Connection header received
0811 07:02:21.743792 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.743800 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.743926 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.744031 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:21.745144 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.746578 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.749280 (+ 2702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.750209 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.750346 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.751279 (+ 933us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.751481 (+ 202us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.751551 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.751895 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.752017 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:02:21.753796 1156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.732118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41227 (local address 127.30.73.65:34585)
0811 07:02:21.742678 (+ 10560us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:21.742715 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:21.743396 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:21.744343 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:21.744350 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:21.744370 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:02:21.744920 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.744937 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.746805 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.746814 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.749078 (+ 2264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.749098 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.750594 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.750602 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.750905 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.751004 (+ 99us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.751720 (+ 716us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.751735 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 07:02:21.753078 (+ 1343us) client_negotiation.cc:240] Negotiation successful
0811 07:02:21.753285 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10291,"thread_start_us":10777,"threads_started":1}
I20260811 07:02:21.777100 864 raft_consensus.cc:1261] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Refusing update from remote peer 17aa696c61e1411c8bd95988c3396b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:21.777047 1021 raft_consensus.cc:1261] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Refusing update from remote peer 17aa696c61e1411c8bd95988c3396b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:21.777967 1105 consensus_queue.cc:1035] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:21.778371 1151 consensus_queue.cc:1035] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:21.842052 1029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.833282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:32943 (local address 127.30.73.67:34719)
0811 07:02:21.833704 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:21.833729 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:21.833877 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:21.834922 (+ 1045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:21.834930 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:21.834950 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:02:21.835224 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.835239 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.837174 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.837181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.838962 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:21.838981 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.840320 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.840329 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:21.840580 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.840650 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.841199 (+ 549us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.841214 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 07:02:21.841302 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:02:21.841528 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247}
I20260811 07:02:21.842903 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:21.834126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:34719 (local address 127.30.73.65:32943)
0811 07:02:21.834320 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:21.834327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:21.834349 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:02:21.834425 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:21.834433 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:21.834558 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:21.834663 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:21.835421 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.836957 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.839162 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:21.840033 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:21.840175 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:21.840875 (+ 700us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:21.841042 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:21.841137 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:21.842372 (+ 1235us) server_negotiation.cc:299] Negotiation successful
0811 07:02:21.842480 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 07:02:21.844836 1124 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 07:02:23.516376 533 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:23.516790 533 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:23.523227 533 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943: Sending DeleteTablet for 3 replicas of tablet 4968dbc223fa496b88702ccf17c2c4c4
I20260811 07:02:23.524658 681 tablet_service.cc:1514] Processing DeleteTablet for tablet 4968dbc223fa496b88702ccf17c2c4c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:23 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:49580
I20260811 07:02:23.524717 838 tablet_service.cc:1514] Processing DeleteTablet for tablet 4968dbc223fa496b88702ccf17c2c4c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:23 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:49968
I20260811 07:02:23.524817 993 tablet_service.cc:1514] Processing DeleteTablet for tablet 4968dbc223fa496b88702ccf17c2c4c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:23 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:44082
I20260811 07:02:23.525957 1186 tablet_replica.cc:330] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: stopping tablet replica
I20260811 07:02:23.526163 1184 tablet_replica.cc:330] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: stopping tablet replica
I20260811 07:02:23.526221 1186 raft_consensus.cc:2229] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:23.526463 1184 raft_consensus.cc:2229] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:02:23.526561 1186 raft_consensus.cc:2258] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:23.527292 1184 raft_consensus.cc:2258] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:23.528007 1186 ts_tablet_manager.cc:1905] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:23.530411 1185 tablet_replica.cc:330] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: stopping tablet replica
I20260811 07:02:23.530687 1185 raft_consensus.cc:2229] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:23.531020 1185 raft_consensus.cc:2258] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:23.531116 1184 ts_tablet_manager.cc:1905] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:23.532161 1185 ts_tablet_manager.cc:1905] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:23.536100 1186 ts_tablet_manager.cc:1918] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:02:23.536288 1186 log.cc:1196] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/4968dbc223fa496b88702ccf17c2c4c4
I20260811 07:02:23.536742 1184 ts_tablet_manager.cc:1918] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:02:23.536852 1186 ts_tablet_manager.cc:1939] T 4968dbc223fa496b88702ccf17c2c4c4 P 24efe473d22047f48744007026d14280: Deleting consensus metadata
I20260811 07:02:23.536922 1184 log.cc:1196] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/4968dbc223fa496b88702ccf17c2c4c4
I20260811 07:02:23.537405 1184 ts_tablet_manager.cc:1939] T 4968dbc223fa496b88702ccf17c2c4c4 P 17aa696c61e1411c8bd95988c3396b5b: Deleting consensus metadata
I20260811 07:02:23.538374 515 catalog_manager.cc:4841] TS 24efe473d22047f48744007026d14280 (127.30.73.67:41227): tablet 4968dbc223fa496b88702ccf17c2c4c4 (table test-table [id=2b887980b00e4b7d9458fcb74f93dc06]) successfully deleted
I20260811 07:02:23.538911 518 catalog_manager.cc:4841] TS 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943): tablet 4968dbc223fa496b88702ccf17c2c4c4 (table test-table [id=2b887980b00e4b7d9458fcb74f93dc06]) successfully deleted
I20260811 07:02:23.540176 1185 ts_tablet_manager.cc:1918] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:02:23.540350 1185 log.cc:1196] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/4968dbc223fa496b88702ccf17c2c4c4
I20260811 07:02:23.540812 1185 ts_tablet_manager.cc:1939] T 4968dbc223fa496b88702ccf17c2c4c4 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting consensus metadata
I20260811 07:02:23.542068 515 catalog_manager.cc:4841] TS 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737): tablet 4968dbc223fa496b88702ccf17c2c4c4 (table test-table [id=2b887980b00e4b7d9458fcb74f93dc06]) successfully deleted
Aug 11 07:02:23 dist-test-slave-69rg krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431743, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:02:23 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431743, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:23.607451 1197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.587354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58038 (local address 127.30.73.126:35667)
0811 07:02:23.588067 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:23.588073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:23.588201 (+ 128us) server_negotiation.cc:407] Connection header received
0811 07:02:23.588407 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:23.588412 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:23.588494 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:23.588642 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:23.590459 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.591487 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.593357 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.593957 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.594086 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.599837 (+ 5751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:23.599844 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:23.599848 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:23.599935 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:23.603776 (+ 3841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:23.604965 (+ 1189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:23.604970 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:23.604973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:23.605157 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:23.605697 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:23.605701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:23.605704 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:23.606205 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:23.606432 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:23.606804 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 07:02:23.607054 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":366,"threads_started":1}
I20260811 07:02:23.612095 533 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:02:23.612912 533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:23.622057 681 tablet_service.cc:1467] Processing CreateTablet for tablet 2f2ba0a944a1426b99fe214171cec5c9 (DEFAULT_TABLE table=test-table [id=8185f41ef1cf41578a17091965db639c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:23.622234 838 tablet_service.cc:1467] Processing CreateTablet for tablet 2f2ba0a944a1426b99fe214171cec5c9 (DEFAULT_TABLE table=test-table [id=8185f41ef1cf41578a17091965db639c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:23.622414 993 tablet_service.cc:1467] Processing CreateTablet for tablet 2f2ba0a944a1426b99fe214171cec5c9 (DEFAULT_TABLE table=test-table [id=8185f41ef1cf41578a17091965db639c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:23.622737 838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f2ba0a944a1426b99fe214171cec5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:23.622731 681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f2ba0a944a1426b99fe214171cec5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:23.622972 993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f2ba0a944a1426b99fe214171cec5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:23.631716 1199 tablet_bootstrap.cc:492] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: Bootstrap starting.
I20260811 07:02:23.630769 1198 tablet_bootstrap.cc:492] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: Bootstrap starting.
I20260811 07:02:23.634191 1199 tablet_bootstrap.cc:654] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:23.634843 1198 tablet_bootstrap.cc:654] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:23.635988 1201 tablet_bootstrap.cc:492] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: Bootstrap starting.
I20260811 07:02:23.638296 1201 tablet_bootstrap.cc:654] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:23.638548 1199 tablet_bootstrap.cc:492] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: No bootstrap required, opened a new log
I20260811 07:02:23.638761 1199 ts_tablet_manager.cc:1397] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 07:02:23.638953 1198 tablet_bootstrap.cc:492] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: No bootstrap required, opened a new log
I20260811 07:02:23.639189 1198 ts_tablet_manager.cc:1397] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260811 07:02:23.639796 1199 raft_consensus.cc:348] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.640130 1199 raft_consensus.cc:374] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:23.640281 1199 raft_consensus.cc:729] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aa696c61e1411c8bd95988c3396b5b, State: Initialized, Role: FOLLOWER
I20260811 07:02:23.640316 1198 raft_consensus.cc:348] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.640628 1199 consensus_queue.cc:260] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.640810 1198 raft_consensus.cc:374] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:23.640933 1198 raft_consensus.cc:729] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24efe473d22047f48744007026d14280, State: Initialized, Role: FOLLOWER
I20260811 07:02:23.641397 1201 tablet_bootstrap.cc:492] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: No bootstrap required, opened a new log
I20260811 07:02:23.641239 1198 consensus_queue.cc:260] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.641597 1201 ts_tablet_manager.cc:1397] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:02:23.642004 1198 ts_tablet_manager.cc:1428] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 07:02:23.642761 1201 raft_consensus.cc:348] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.643221 1201 raft_consensus.cc:374] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:23.643355 1201 raft_consensus.cc:729] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17753be418ba4ee8bd2bf858347a6ac1, State: Initialized, Role: FOLLOWER
I20260811 07:02:23.643990 1201 consensus_queue.cc:260] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.644290 1199 ts_tablet_manager.cc:1428] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 07:02:23.645241 1201 ts_tablet_manager.cc:1428] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 07:02:23.754618 1205 raft_consensus.cc:482] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:23.755008 1205 raft_consensus.cc:504] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.757141 1205 leader_election.cc:288] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943), 24efe473d22047f48744007026d14280 (127.30.73.67:41227)
I20260811 07:02:23.776809 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.757756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:54691 (local address 127.30.73.67:41227)
0811 07:02:23.768588 (+ 10832us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:23.768598 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:23.769460 (+ 862us) server_negotiation.cc:407] Connection header received
0811 07:02:23.769714 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:23.769718 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:23.769798 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:23.769990 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:23.770825 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.771710 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.774516 (+ 2806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.775463 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.775738 (+ 275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.775835 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:23.776170 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 07:02:23.776350 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10621,"thread_start_us":10366,"threads_started":1}
I20260811 07:02:23.777143 1206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.757431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:32943 (local address 127.30.73.66:51799)
0811 07:02:23.769040 (+ 11609us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:23.769065 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:23.769346 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:23.769874 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:23.769882 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:23.769929 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:23.770429 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:23.770444 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.771809 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.771817 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:23.774264 (+ 2447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:23.774291 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.776162 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.776172 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:23.776323 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.776348 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:02:23.776468 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 07:02:23.776622 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11407,"mutex_wait_us":87,"thread_start_us":11176,"threads_started":1}
I20260811 07:02:23.776871 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.757677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41227 (local address 127.30.73.66:54691)
0811 07:02:23.769300 (+ 11623us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:23.769319 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:23.769539 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:23.770013 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:23.770017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:23.770075 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:23.770598 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:23.770608 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.771871 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.771879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:23.774296 (+ 2417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:23.774320 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.775776 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.775784 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:23.775970 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.776000 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:02:23.776136 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 07:02:23.776334 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11468,"mutex_wait_us":179,"thread_start_us":11185,"threads_started":1}
I20260811 07:02:23.777307 1209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.757726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:51799 (local address 127.30.73.65:32943)
0811 07:02:23.768280 (+ 10554us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:23.768289 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:23.769223 (+ 934us) server_negotiation.cc:407] Connection header received
0811 07:02:23.769578 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:23.769583 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:23.769667 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:23.769800 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:23.770641 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.771638 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.774520 (+ 2882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.775452 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.775736 (+ 284us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.775833 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:23.776530 (+ 697us) server_negotiation.cc:299] Negotiation successful
0811 07:02:23.776701 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10320,"thread_start_us":10069,"threads_started":1}
I20260811 07:02:23.778296 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f2ba0a944a1426b99fe214171cec5c9" candidate_uuid: "17753be418ba4ee8bd2bf858347a6ac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aa696c61e1411c8bd95988c3396b5b" is_pre_election: true
I20260811 07:02:23.778297 1021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f2ba0a944a1426b99fe214171cec5c9" candidate_uuid: "17753be418ba4ee8bd2bf858347a6ac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24efe473d22047f48744007026d14280" is_pre_election: true
I20260811 07:02:23.778707 1021 raft_consensus.cc:2454] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17753be418ba4ee8bd2bf858347a6ac1 in term 0.
I20260811 07:02:23.778708 706 raft_consensus.cc:2454] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17753be418ba4ee8bd2bf858347a6ac1 in term 0.
I20260811 07:02:23.779518 786 leader_election.cc:302] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17753be418ba4ee8bd2bf858347a6ac1, 17aa696c61e1411c8bd95988c3396b5b; no voters:
I20260811 07:02:23.780117 1205 raft_consensus.cc:2781] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:23.780246 1205 raft_consensus.cc:482] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:23.780441 1205 raft_consensus.cc:3037] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:23.784133 1205 raft_consensus.cc:504] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.785260 1205 leader_election.cc:288] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [CANDIDATE]: Term 1 election: Requested vote from peers 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943), 24efe473d22047f48744007026d14280 (127.30.73.67:41227)
I20260811 07:02:23.786084 1021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f2ba0a944a1426b99fe214171cec5c9" candidate_uuid: "17753be418ba4ee8bd2bf858347a6ac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24efe473d22047f48744007026d14280"
I20260811 07:02:23.786429 1021 raft_consensus.cc:3037] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:23.786640 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f2ba0a944a1426b99fe214171cec5c9" candidate_uuid: "17753be418ba4ee8bd2bf858347a6ac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aa696c61e1411c8bd95988c3396b5b"
I20260811 07:02:23.786967 706 raft_consensus.cc:3037] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:23.788930 1021 raft_consensus.cc:2454] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17753be418ba4ee8bd2bf858347a6ac1 in term 1.
I20260811 07:02:23.789368 706 raft_consensus.cc:2454] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17753be418ba4ee8bd2bf858347a6ac1 in term 1.
I20260811 07:02:23.789469 783 leader_election.cc:302] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17753be418ba4ee8bd2bf858347a6ac1, 24efe473d22047f48744007026d14280; no voters:
I20260811 07:02:23.789911 1205 raft_consensus.cc:2781] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:23.790613 1205 raft_consensus.cc:686] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 LEADER]: Becoming Leader. State: Replica: 17753be418ba4ee8bd2bf858347a6ac1, State: Running, Role: LEADER
I20260811 07:02:23.791380 1205 consensus_queue.cc:237] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.795446 531 catalog_manager.cc:5495] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66). New cstate: current_term: 1 leader_uuid: "17753be418ba4ee8bd2bf858347a6ac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260811 07:02:23.844794 1213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.838580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49972 (local address 127.30.73.66:35737)
0811 07:02:23.839193 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:23.839197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:23.839222 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:02:23.839313 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:23.839317 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:23.839391 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:23.839546 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:23.840006 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.840874 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.842345 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.842860 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.842987 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.843443 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:23.844181 (+ 738us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:23.844299 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:23.844421 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 07:02:23.844495 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":364,"threads_started":1}
I20260811 07:02:23.861451 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.855540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:42683 (local address 127.30.73.67:41227)
0811 07:02:23.855826 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:23.855832 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:23.856208 (+ 376us) server_negotiation.cc:407] Connection header received
0811 07:02:23.856395 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:23.856399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:23.856472 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:23.856556 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:23.857014 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.857782 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.859637 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.860082 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.860220 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.860686 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:23.860806 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:23.860877 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:23.861149 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 07:02:23.861228 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 07:02:23.861478 1216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.855340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41227 (local address 127.30.73.66:42683)
0811 07:02:23.856090 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:23.856107 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:23.856270 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:23.856581 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:23.856584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:23.856594 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:02:23.856864 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:23.856872 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.857984 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.857988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:23.859486 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:23.859502 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.860295 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.860300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:23.860442 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.860511 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:02:23.860938 (+ 427us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:02:23.860951 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 07:02:23.861037 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 07:02:23.861166 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":428,"threads_started":1}
I20260811 07:02:23.870155 1021 raft_consensus.cc:1261] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Refusing update from remote peer 17753be418ba4ee8bd2bf858347a6ac1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:23.870407 706 raft_consensus.cc:1261] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Refusing update from remote peer 17753be418ba4ee8bd2bf858347a6ac1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:23.870949 1210 consensus_queue.cc:1035] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:23.871368 1205 consensus_queue.cc:1035] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:23.903112 1213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.896367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:43429 (local address 127.30.73.66:35737)
0811 07:02:23.896540 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:23.896544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:23.897169 (+ 625us) server_negotiation.cc:407] Connection header received
0811 07:02:23.897439 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:23.897444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:23.897523 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:23.897636 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:23.898365 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.899388 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.901073 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.901626 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.901736 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.902341 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:23.902479 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:23.902574 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:23.902724 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 07:02:23.902810 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:02:23.903230 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:23.896235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:35737 (local address 127.30.73.67:43429)
0811 07:02:23.897055 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:23.897076 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:23.897297 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:23.897653 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:23.897658 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:23.897670 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:02:23.898144 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:23.898159 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.899563 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.899567 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:23.900900 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:23.900916 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:23.901953 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:23.901959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:23.902132 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:23.902170 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:02:23.902591 (+ 421us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:02:23.902602 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:02:23.902684 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:02:23.902831 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":498,"threads_started":1}
I20260811 07:02:23.937844 533 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:23.938122 533 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:23.941380 533 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943: Sending DeleteTablet for 3 replicas of tablet 2f2ba0a944a1426b99fe214171cec5c9
I20260811 07:02:23.942281 681 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f2ba0a944a1426b99fe214171cec5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:23 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:49580
I20260811 07:02:23.942449 838 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f2ba0a944a1426b99fe214171cec5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:23 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:49968
I20260811 07:02:23.942495 993 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f2ba0a944a1426b99fe214171cec5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:23 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:44082
I20260811 07:02:23.942623 1184 tablet_replica.cc:330] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: stopping tablet replica
I20260811 07:02:23.942788 1185 tablet_replica.cc:330] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: stopping tablet replica
I20260811 07:02:23.942834 1186 tablet_replica.cc:330] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: stopping tablet replica
I20260811 07:02:23.942866 1184 raft_consensus.cc:2229] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:23.943007 1185 raft_consensus.cc:2229] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:02:23.943030 1186 raft_consensus.cc:2229] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:23.943114 1184 raft_consensus.cc:2258] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:23.943218 1186 raft_consensus.cc:2258] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:23.943553 1185 raft_consensus.cc:2258] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:23.944602 1186 ts_tablet_manager.cc:1905] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:23.944432 533 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 07:02:23.944949 1184 ts_tablet_manager.cc:1905] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:02:23.945151 533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:23.948627 1185 ts_tablet_manager.cc:1905] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:23.951866 1184 ts_tablet_manager.cc:1918] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:02:23.952028 1184 log.cc:1196] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/2f2ba0a944a1426b99fe214171cec5c9
I20260811 07:02:23.952533 1184 ts_tablet_manager.cc:1939] T 2f2ba0a944a1426b99fe214171cec5c9 P 17aa696c61e1411c8bd95988c3396b5b: Deleting consensus metadata
I20260811 07:02:23.952564 1186 ts_tablet_manager.cc:1918] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:02:23.953840 518 catalog_manager.cc:4841] TS 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943): tablet 2f2ba0a944a1426b99fe214171cec5c9 (table test-table [id=8185f41ef1cf41578a17091965db639c]) successfully deleted
I20260811 07:02:23.955941 1185 ts_tablet_manager.cc:1918] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:02:23.956146 1185 log.cc:1196] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/2f2ba0a944a1426b99fe214171cec5c9
I20260811 07:02:23.956189 1186 log.cc:1196] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/2f2ba0a944a1426b99fe214171cec5c9
I20260811 07:02:23.956677 1185 ts_tablet_manager.cc:1939] T 2f2ba0a944a1426b99fe214171cec5c9 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting consensus metadata
I20260811 07:02:23.956701 1186 ts_tablet_manager.cc:1939] T 2f2ba0a944a1426b99fe214171cec5c9 P 24efe473d22047f48744007026d14280: Deleting consensus metadata
I20260811 07:02:23.958474 993 tablet_service.cc:1467] Processing CreateTablet for tablet 66094b5e1a5e417f931e1264ef768176 (DEFAULT_TABLE table=test-table [id=230242bc1a5c4d2787ba837c3fb39852]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:23.958493 838 tablet_service.cc:1467] Processing CreateTablet for tablet 66094b5e1a5e417f931e1264ef768176 (DEFAULT_TABLE table=test-table [id=230242bc1a5c4d2787ba837c3fb39852]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:23.958963 993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66094b5e1a5e417f931e1264ef768176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:23.958972 838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66094b5e1a5e417f931e1264ef768176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:23.960054 515 catalog_manager.cc:4841] TS 24efe473d22047f48744007026d14280 (127.30.73.67:41227): tablet 2f2ba0a944a1426b99fe214171cec5c9 (table test-table [id=8185f41ef1cf41578a17091965db639c]) successfully deleted
I20260811 07:02:23.960280 515 catalog_manager.cc:4841] TS 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737): tablet 2f2ba0a944a1426b99fe214171cec5c9 (table test-table [id=8185f41ef1cf41578a17091965db639c]) successfully deleted
I20260811 07:02:23.960799 681 tablet_service.cc:1467] Processing CreateTablet for tablet 66094b5e1a5e417f931e1264ef768176 (DEFAULT_TABLE table=test-table [id=230242bc1a5c4d2787ba837c3fb39852]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:23.961272 681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66094b5e1a5e417f931e1264ef768176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:23.965474 1198 tablet_bootstrap.cc:492] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: Bootstrap starting.
I20260811 07:02:23.965996 1201 tablet_bootstrap.cc:492] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: Bootstrap starting.
I20260811 07:02:23.967342 1198 tablet_bootstrap.cc:654] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:23.967795 1201 tablet_bootstrap.cc:654] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:23.969065 1199 tablet_bootstrap.cc:492] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: Bootstrap starting.
I20260811 07:02:23.971233 1199 tablet_bootstrap.cc:654] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:23.977463 1198 tablet_bootstrap.cc:492] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: No bootstrap required, opened a new log
I20260811 07:02:23.977794 1198 ts_tablet_manager.cc:1397] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260811 07:02:23.978924 1198 raft_consensus.cc:348] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.979382 1198 raft_consensus.cc:374] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:23.979548 1198 raft_consensus.cc:729] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24efe473d22047f48744007026d14280, State: Initialized, Role: FOLLOWER
I20260811 07:02:23.979996 1198 consensus_queue.cc:260] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.982086 1198 ts_tablet_manager.cc:1428] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260811 07:02:23.984349 1199 tablet_bootstrap.cc:492] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: No bootstrap required, opened a new log
I20260811 07:02:23.984547 1199 ts_tablet_manager.cc:1397] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.000s
I20260811 07:02:23.987228 1201 tablet_bootstrap.cc:492] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: No bootstrap required, opened a new log
I20260811 07:02:23.987249 1199 raft_consensus.cc:348] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.987437 1201 ts_tablet_manager.cc:1397] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.012s
I20260811 07:02:23.987578 1199 raft_consensus.cc:374] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:23.987814 1199 raft_consensus.cc:729] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aa696c61e1411c8bd95988c3396b5b, State: Initialized, Role: FOLLOWER
I20260811 07:02:23.988157 1199 consensus_queue.cc:260] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.988289 1201 raft_consensus.cc:348] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.988574 1201 raft_consensus.cc:374] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:23.988673 1201 raft_consensus.cc:729] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17753be418ba4ee8bd2bf858347a6ac1, State: Initialized, Role: FOLLOWER
I20260811 07:02:23.988790 1199 ts_tablet_manager.cc:1428] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 07:02:23.988960 1201 consensus_queue.cc:260] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:23.990283 1201 ts_tablet_manager.cc:1428] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 07:02:24.039371 1130 raft_consensus.cc:482] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:24.039741 1130 raft_consensus.cc:504] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:24.040612 1130 leader_election.cc:288] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943), 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737)
I20260811 07:02:24.041503 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66094b5e1a5e417f931e1264ef768176" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aa696c61e1411c8bd95988c3396b5b" is_pre_election: true
I20260811 07:02:24.041780 706 raft_consensus.cc:2454] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 0.
I20260811 07:02:24.042240 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66094b5e1a5e417f931e1264ef768176" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17753be418ba4ee8bd2bf858347a6ac1" is_pre_election: true
I20260811 07:02:24.042335 940 leader_election.cc:302] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aa696c61e1411c8bd95988c3396b5b, 24efe473d22047f48744007026d14280; no voters:
I20260811 07:02:24.042506 864 raft_consensus.cc:2454] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 0.
I20260811 07:02:24.042646 1130 raft_consensus.cc:2781] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:24.042744 1130 raft_consensus.cc:482] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:24.042850 1130 raft_consensus.cc:3037] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:24.045266 1130 raft_consensus.cc:504] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:24.046094 1130 leader_election.cc:288] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 election: Requested vote from peers 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943), 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737)
I20260811 07:02:24.046636 706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66094b5e1a5e417f931e1264ef768176" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aa696c61e1411c8bd95988c3396b5b"
I20260811 07:02:24.046883 706 raft_consensus.cc:3037] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:24.046900 864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66094b5e1a5e417f931e1264ef768176" candidate_uuid: "24efe473d22047f48744007026d14280" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17753be418ba4ee8bd2bf858347a6ac1"
I20260811 07:02:24.047204 864 raft_consensus.cc:3037] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:24.050920 706 raft_consensus.cc:2454] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 1.
I20260811 07:02:24.051419 864 raft_consensus.cc:2454] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24efe473d22047f48744007026d14280 in term 1.
I20260811 07:02:24.051594 940 leader_election.cc:302] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aa696c61e1411c8bd95988c3396b5b, 24efe473d22047f48744007026d14280; no voters:
I20260811 07:02:24.051986 1130 raft_consensus.cc:2781] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:24.052570 1130 raft_consensus.cc:686] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 1 LEADER]: Becoming Leader. State: Replica: 24efe473d22047f48744007026d14280, State: Running, Role: LEADER
I20260811 07:02:24.052881 1130 consensus_queue.cc:237] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } }
I20260811 07:02:24.056533 531 catalog_manager.cc:5495] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24efe473d22047f48744007026d14280 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "24efe473d22047f48744007026d14280" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24efe473d22047f48744007026d14280" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260811 07:02:24.100061 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:24.092589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44120 (local address 127.30.73.67:41227)
0811 07:02:24.092834 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:24.092839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:24.092860 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:02:24.093103 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:24.093107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:24.093181 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:24.093278 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:24.093813 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:24.095039 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:24.097057 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:24.097963 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:24.098107 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:24.098719 (+ 612us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:24.098973 (+ 254us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:24.099062 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:24.099552 (+ 490us) server_negotiation.cc:299] Negotiation successful
0811 07:02:24.099782 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:02:24.113054 864 raft_consensus.cc:1261] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Refusing update from remote peer 24efe473d22047f48744007026d14280: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:24.113762 1169 consensus_queue.cc:1035] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17753be418ba4ee8bd2bf858347a6ac1" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:24.114082 706 raft_consensus.cc:1261] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Refusing update from remote peer 24efe473d22047f48744007026d14280: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:24.114813 1169 consensus_queue.cc:1035] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aa696c61e1411c8bd95988c3396b5b" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 32943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:02:24.142213 1162 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 07:02:25.757045 531 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:25.757408 531 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:25.763108 531 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d32f754854c4d659eca394dc8b6a943: Sending DeleteTablet for 3 replicas of tablet 66094b5e1a5e417f931e1264ef768176
I20260811 07:02:25.764315 681 tablet_service.cc:1514] Processing DeleteTablet for tablet 66094b5e1a5e417f931e1264ef768176 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:25 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:49580
I20260811 07:02:25.764389 838 tablet_service.cc:1514] Processing DeleteTablet for tablet 66094b5e1a5e417f931e1264ef768176 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:25 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:49968
I20260811 07:02:25.764498 993 tablet_service.cc:1514] Processing DeleteTablet for tablet 66094b5e1a5e417f931e1264ef768176 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:25 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:44082
I20260811 07:02:25.765588 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 610
I20260811 07:02:25.777522 1255 tablet_replica.cc:330] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: stopping tablet replica
I20260811 07:02:25.777947 1255 raft_consensus.cc:2229] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:02:25.778182 1254 tablet_replica.cc:330] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: stopping tablet replica
I20260811 07:02:25.778704 1255 raft_consensus.cc:2258] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:25.778667 1254 raft_consensus.cc:2229] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:25.779034 1254 raft_consensus.cc:2258] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:25.779361 1253 tablet_replica.cc:330] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: stopping tablet replica
I20260811 07:02:25.780055 1253 raft_consensus.cc:2229] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:25.780392 1253 raft_consensus.cc:2258] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:25.780984 1254 ts_tablet_manager.cc:1905] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:25.781574 1253 ts_tablet_manager.cc:1905] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:25.781579 1255 ts_tablet_manager.cc:1905] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:25.789698 1253 ts_tablet_manager.cc:1918] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:02:25.789709 1255 ts_tablet_manager.cc:1918] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:02:25.789959 1255 log.cc:1196] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/66094b5e1a5e417f931e1264ef768176
I20260811 07:02:25.789960 1253 log.cc:1196] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/66094b5e1a5e417f931e1264ef768176
I20260811 07:02:25.790400 1254 ts_tablet_manager.cc:1918] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:02:25.790545 1255 ts_tablet_manager.cc:1939] T 66094b5e1a5e417f931e1264ef768176 P 24efe473d22047f48744007026d14280: Deleting consensus metadata
I20260811 07:02:25.790560 1253 ts_tablet_manager.cc:1939] T 66094b5e1a5e417f931e1264ef768176 P 17aa696c61e1411c8bd95988c3396b5b: Deleting consensus metadata
I20260811 07:02:25.790750 1254 log.cc:1196] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/66094b5e1a5e417f931e1264ef768176
I20260811 07:02:25.791538 1254 ts_tablet_manager.cc:1939] T 66094b5e1a5e417f931e1264ef768176 P 17753be418ba4ee8bd2bf858347a6ac1: Deleting consensus metadata
I20260811 07:02:25.792101 515 catalog_manager.cc:4841] TS 24efe473d22047f48744007026d14280 (127.30.73.67:41227): tablet 66094b5e1a5e417f931e1264ef768176 (table test-table [id=230242bc1a5c4d2787ba837c3fb39852]) successfully deleted
I20260811 07:02:25.792101 518 catalog_manager.cc:4841] TS 17aa696c61e1411c8bd95988c3396b5b (127.30.73.65:32943): tablet 66094b5e1a5e417f931e1264ef768176 (table test-table [id=230242bc1a5c4d2787ba837c3fb39852]) successfully deleted
I20260811 07:02:25.793092 515 catalog_manager.cc:4841] TS 17753be418ba4ee8bd2bf858347a6ac1 (127.30.73.66:35737): tablet 66094b5e1a5e417f931e1264ef768176 (table test-table [id=230242bc1a5c4d2787ba837c3fb39852]) successfully deleted
Aug 11 07:02:25 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431743, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:25.802306 1258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:25.767535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49606 (local address 127.30.73.65:32943)
0811 07:02:25.779953 (+ 12418us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:25.779960 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:25.779997 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:02:25.780412 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:25.780419 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:25.780523 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:25.780646 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:25.783423 (+ 2777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:25.784784 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:25.787026 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:25.787980 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:25.788148 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:25.794888 (+ 6740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:25.794909 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:25.794932 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:25.794986 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:25.798593 (+ 3607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:25.799435 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:25.799473 (+ 38us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:25.799475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:25.799636 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:25.800138 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:25.800147 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:25.800151 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:25.800682 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:25.800988 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:25.801543 (+ 555us) server_negotiation.cc:299] Negotiation successful
0811 07:02:25.801902 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12241,"thread_start_us":11727,"threads_started":1}
W20260811 07:02:25.803189 756 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49606
W20260811 07:02:25.804339 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 610: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:02:25.804682 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 610
I20260811 07:02:25.840314 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 766
Aug 11 07:02:25 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431743, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:02:25.857621 1259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:25.841231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49986 (local address 127.30.73.66:35737)
0811 07:02:25.841918 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:25.841923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:25.841940 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:02:25.842003 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:25.842007 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:25.842073 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:25.842201 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:25.843805 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:25.844622 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:25.845979 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:25.846395 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:25.846492 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:25.851224 (+ 4732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:25.851241 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:25.851260 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:25.851303 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:25.854748 (+ 3445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:25.855532 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:25.855540 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:25.855542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:25.855704 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:25.856113 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:25.856117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:25.856119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:25.856572 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:25.856847 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:25.857117 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 07:02:25.857299 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":291,"threads_started":1}
W20260811 07:02:25.858583 909 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49986
W20260811 07:02:25.859318 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 766: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:02:25.859473 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 766
I20260811 07:02:25.889951 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 918
Aug 11 07:02:25 dist-test-slave-69rg krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431743, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:02:25.907387 1260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:25.890804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44126 (local address 127.30.73.67:41227)
0811 07:02:25.891406 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:25.891411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:25.891428 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:02:25.891492 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:25.891496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:25.891562 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:25.891734 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:25.893150 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:25.894145 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:25.895436 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:25.895924 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:25.896040 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:25.900930 (+ 4890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:25.900948 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:25.900966 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:25.901006 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:25.904311 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:25.905067 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:25.905074 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:25.905077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:25.905228 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:25.905759 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:25.905763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:25.905766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:25.906247 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:25.906514 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:25.906786 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 07:02:25.906968 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":320,"threads_started":1}
W20260811 07:02:25.908094 1068 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44126
W20260811 07:02:25.908813 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 918: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:02:25.908967 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 918
I20260811 07:02:25.942253 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 499
I20260811 07:02:25.943704 579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:26.069690 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 499
2026-08-11T07:02:26Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8931 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:26 dist-test-slave-69rg krb5kdc[1265](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:26 dist-test-slave-69rg krb5kdc[1265](info): set up 2 sockets
Aug 11 07:02:26 dist-test-slave-69rg krb5kdc[1265](info): commencing operation
krb5kdc: starting...
W20260811 07:02:27.290817 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.003s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:27 dist-test-slave-69rg krb5kdc[1265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:27.523402 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:42515
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:40489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:42515
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:27.870939 1280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:27.871264 1280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:27.871421 1280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:27.878885 1280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:27.879014 1280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:27.879112 1280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:27.879202 1280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:27.879244 1280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:27.892767 1280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:40489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:42515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:42515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:27.894667 1280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:27.896430 1280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:27.911804 1286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:27.911772 1288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:27.911775 1290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:27.912940 1280 server_base.cc:1034] running on GCE node
I20260811 07:02:27.914088 1280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:27.916019 1280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:27.917361 1280 hybrid_clock.cc:648] HybridClock initialized: now 1786431747917269 us; error 62 us; skew 500 ppm
I20260811 07:02:27.917872 1280 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:27 dist-test-slave-69rg krb5kdc[1265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431747, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:27.921854 1280 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:27.923746 1280 webserver.cc:460] Webserver started at http://127.30.73.126:44813/ using document root <none> and password file <none>
I20260811 07:02:27.924629 1280 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:27.924794 1280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:27.925211 1280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:27.929059 1280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "9fd59454d99341c89f95c39c8f5c6bac"
format_stamp: "Formatted at 2026-08-11 07:02:27 on dist-test-slave-69rg"
server_key: "dd801c9028798928694d7655eee20eb5"
server_key_iv: "fb266f4e229ccd5186023f3d77aeca37"
server_key_version: "encryptionkey@0"
I20260811 07:02:27.930146 1280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "9fd59454d99341c89f95c39c8f5c6bac"
format_stamp: "Formatted at 2026-08-11 07:02:27 on dist-test-slave-69rg"
server_key: "dd801c9028798928694d7655eee20eb5"
server_key_iv: "fb266f4e229ccd5186023f3d77aeca37"
server_key_version: "encryptionkey@0"
I20260811 07:02:27.937184 1280 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260811 07:02:27.941774 1299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:27.943630 1280 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:02:27.943876 1280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "9fd59454d99341c89f95c39c8f5c6bac"
format_stamp: "Formatted at 2026-08-11 07:02:27 on dist-test-slave-69rg"
server_key: "dd801c9028798928694d7655eee20eb5"
server_key_iv: "fb266f4e229ccd5186023f3d77aeca37"
server_key_version: "encryptionkey@0"
I20260811 07:02:27.944137 1280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:27.961014 1280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:27.966446 1280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:27.966877 1280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:27.990087 1280 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:42515
I20260811 07:02:27.990091 1355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:42515 every 8 connection(s)
I20260811 07:02:27.991994 1280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:27.996810 1356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:27.997974 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 1280
I20260811 07:02:27.998291 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:27.999078 31013 external_mini_cluster.cc:1428] Setting key f7aa36ba0253a30243675c7fc4c8249f
I20260811 07:02:28.016499 1356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac: Bootstrap starting.
Aug 11 07:02:28 dist-test-slave-69rg krb5kdc[1265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:28.021780 1356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:28.023833 1356 log.cc:824] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:28.028688 1356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac: No bootstrap required, opened a new log
I20260811 07:02:28.031525 1360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:28.001757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41542 (local address 127.30.73.126:42515)
0811 07:02:28.002836 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:28.002863 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:28.002929 (+ 66us) server_negotiation.cc:407] Connection header received
0811 07:02:28.005018 (+ 2089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:28.005061 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:28.006084 (+ 1023us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:28.006741 (+ 657us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:28.009185 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:28.011596 (+ 2411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:28.013274 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:28.014596 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:28.014835 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:28.019953 (+ 5118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:28.019970 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:28.020002 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:28.020080 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:28.025398 (+ 5318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:28.026565 (+ 1167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:28.026578 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:28.026588 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:28.026841 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:28.027329 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:28.027334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:28.027337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:28.028252 (+ 915us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:28.028593 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:28.029123 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 07:02:28.029738 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":778,"thread_start_us":407,"threads_started":1}
I20260811 07:02:28.039309 1356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fd59454d99341c89f95c39c8f5c6bac" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42515 } }
I20260811 07:02:28.039834 1356 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:28.039927 1356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd59454d99341c89f95c39c8f5c6bac, State: Initialized, Role: FOLLOWER
I20260811 07:02:28.040726 1356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fd59454d99341c89f95c39c8f5c6bac" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42515 } }
I20260811 07:02:28.040998 1356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:28.041152 1356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:28.041375 1356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:28.044867 1356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fd59454d99341c89f95c39c8f5c6bac" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42515 } }
I20260811 07:02:28.045540 1356 leader_election.cc:302] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fd59454d99341c89f95c39c8f5c6bac; no voters:
I20260811 07:02:28.046445 1356 leader_election.cc:288] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:28.046665 1362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:28.047595 1362 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [term 1 LEADER]: Becoming Leader. State: Replica: 9fd59454d99341c89f95c39c8f5c6bac, State: Running, Role: LEADER
I20260811 07:02:28.048454 1362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fd59454d99341c89f95c39c8f5c6bac" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42515 } }
I20260811 07:02:28.049460 1356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:28.052861 1363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fd59454d99341c89f95c39c8f5c6bac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fd59454d99341c89f95c39c8f5c6bac" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42515 } } }
I20260811 07:02:28.052901 1364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fd59454d99341c89f95c39c8f5c6bac. Latest consensus state: current_term: 1 leader_uuid: "9fd59454d99341c89f95c39c8f5c6bac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fd59454d99341c89f95c39c8f5c6bac" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42515 } } }
I20260811 07:02:28.053737 1363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:28.054140 1364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:28.056743 1371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:28.066365 1371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:28.080830 1371 catalog_manager.cc:1347] Generated new cluster ID: 7a14e757870543e0afcb30d89b8b5abe
I20260811 07:02:28.081013 1371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:28.106395 1371 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:28.108958 1371 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:28.125406 1371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fd59454d99341c89f95c39c8f5c6bac: Generated new TSK 0
I20260811 07:02:28.126892 1371 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:02:28.211740 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42515
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:40489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:28.669489 1387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:28.669977 1387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:28.670169 1387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:28.678665 1387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:28.678880 1387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:28.679075 1387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:28.690557 1387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:40489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:28.692484 1387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:28.694291 1387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:28.710000 1392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:28.710151 1396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:28.710075 1393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:28.711129 1387 server_base.cc:1034] running on GCE node
I20260811 07:02:28.712119 1387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:28.713341 1387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:28.714603 1387 hybrid_clock.cc:648] HybridClock initialized: now 1786431748714533 us; error 67 us; skew 500 ppm
I20260811 07:02:28.715006 1387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:28 dist-test-slave-69rg krb5kdc[1265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431748, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:28.719149 1387 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:02:28.721213 1387 webserver.cc:460] Webserver started at http://127.30.73.65:34947/ using document root <none> and password file <none>
I20260811 07:02:28.722371 1387 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:28.722558 1387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:28.722966 1387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:28.727005 1387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "6a47fa7b63a5495a953c8f58d8dd6900"
format_stamp: "Formatted at 2026-08-11 07:02:28 on dist-test-slave-69rg"
server_key: "5e2ce6bcaea50150e45c058aab6f8875"
server_key_iv: "0f48b9f98e8d6405fad92b879d9ee3c4"
server_key_version: "encryptionkey@0"
I20260811 07:02:28.728144 1387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "6a47fa7b63a5495a953c8f58d8dd6900"
format_stamp: "Formatted at 2026-08-11 07:02:28 on dist-test-slave-69rg"
server_key: "5e2ce6bcaea50150e45c058aab6f8875"
server_key_iv: "0f48b9f98e8d6405fad92b879d9ee3c4"
server_key_version: "encryptionkey@0"
I20260811 07:02:28.735004 1387 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 07:02:28.739631 1404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:28.741362 1387 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:02:28.741652 1387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "6a47fa7b63a5495a953c8f58d8dd6900"
format_stamp: "Formatted at 2026-08-11 07:02:28 on dist-test-slave-69rg"
server_key: "5e2ce6bcaea50150e45c058aab6f8875"
server_key_iv: "0f48b9f98e8d6405fad92b879d9ee3c4"
server_key_version: "encryptionkey@0"
I20260811 07:02:28.741977 1387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:28.783332 1387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:28.789211 1387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:28.789621 1387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:28.790905 1387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:28.792604 1387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:28.792694 1387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:28.792874 1387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:28.792950 1387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:28.832260 1387 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:44739
I20260811 07:02:28.832350 1528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:44739 every 8 connection(s)
I20260811 07:02:28.833909 1387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:28.840512 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 1387
I20260811 07:02:28.840806 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:28.841558 31013 external_mini_cluster.cc:1428] Setting key 7406cc96848f2b7ace762fa08145a25f
Aug 11 07:02:28 dist-test-slave-69rg krb5kdc[1265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431748, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:28.859797 1531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:28.837314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:57921 (local address 127.30.73.126:42515)
0811 07:02:28.837966 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:28.837971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:28.839200 (+ 1229us) server_negotiation.cc:407] Connection header received
0811 07:02:28.841588 (+ 2388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:28.841595 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:28.841709 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:28.841874 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:28.844016 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:28.844809 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:28.846668 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:28.847101 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:28.847246 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:28.851653 (+ 4407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:28.851659 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:28.851662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:28.851707 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:28.855178 (+ 3471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:28.856305 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:28.856310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:28.856313 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:28.856533 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:28.857189 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:28.857194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:28.857196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:28.857699 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:28.857916 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:28.859074 (+ 1158us) server_negotiation.cc:299] Negotiation successful
0811 07:02:28.859368 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":272,"threads_started":1}
I20260811 07:02:28.861543 1532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:28.838150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:42515 (local address 127.30.73.65:57921)
0811 07:02:28.838997 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:28.839049 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:28.841243 (+ 2194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:28.842187 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:28.842198 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:28.842882 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:28.843821 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:28.843846 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:28.844987 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:28.844991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:28.846521 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:28.846534 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:28.847362 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:28.847369 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:28.847696 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:28.848513 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:28.848540 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:28.851387 (+ 2847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:28.855350 (+ 3963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:28.855364 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:28.855393 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:28.856146 (+ 753us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:28.856704 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:28.856713 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:28.856719 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:28.857008 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:28.857897 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:28.857909 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:28.858508 (+ 599us) client_negotiation.cc:769] Sending connection context
0811 07:02:28.858929 (+ 421us) client_negotiation.cc:240] Negotiation successful
0811 07:02:28.859663 (+ 734us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":339,"threads_started":1}
I20260811 07:02:28.863761 1529 heartbeater.cc:347] Connected to a master server at 127.30.73.126:42515
I20260811 07:02:28.864189 1529 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:28.865353 1529 heartbeater.cc:511] Master 127.30.73.126:42515 requested a full tablet report, sending...
I20260811 07:02:28.868391 1319 ts_manager.cc:194] Registered new tserver with Master: 6a47fa7b63a5495a953c8f58d8dd6900 (127.30.73.65:44739)
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
I20260811 07:02:28.870389 1319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:57921
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:02:28.907423 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42515
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:40489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:29.272723 1535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:29.273013 1535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:29.273182 1535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:29.280555 1535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:29.280661 1535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:29.280869 1535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:29.290795 1535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:40489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:29.292163 1535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:29.293520 1535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:29.308388 1542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:29.308478 1544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:29.308809 1548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:29.309382 1535 server_base.cc:1034] running on GCE node
I20260811 07:02:29.310091 1535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:29.311060 1535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:29.312279 1535 hybrid_clock.cc:648] HybridClock initialized: now 1786431749312230 us; error 36 us; skew 500 ppm
I20260811 07:02:29.312618 1535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:29 dist-test-slave-69rg krb5kdc[1265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431749, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:29.316040 1535 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:02:29.317643 1535 webserver.cc:460] Webserver started at http://127.30.73.66:35239/ using document root <none> and password file <none>
I20260811 07:02:29.318425 1535 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:29.318574 1535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:29.318912 1535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:29.322017 1535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "e55cea6cb2194ada8a9bc5ca37b6795a"
format_stamp: "Formatted at 2026-08-11 07:02:29 on dist-test-slave-69rg"
server_key: "48bc7c135a7ff15ee9116e54a9df4cc0"
server_key_iv: "daa00f4ea82f62901aad0bb08b111f41"
server_key_version: "encryptionkey@0"
I20260811 07:02:29.322909 1535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "e55cea6cb2194ada8a9bc5ca37b6795a"
format_stamp: "Formatted at 2026-08-11 07:02:29 on dist-test-slave-69rg"
server_key: "48bc7c135a7ff15ee9116e54a9df4cc0"
server_key_iv: "daa00f4ea82f62901aad0bb08b111f41"
server_key_version: "encryptionkey@0"
I20260811 07:02:29.328567 1535 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:29.332484 1555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:29.334060 1535 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:02:29.334256 1535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "e55cea6cb2194ada8a9bc5ca37b6795a"
format_stamp: "Formatted at 2026-08-11 07:02:29 on dist-test-slave-69rg"
server_key: "48bc7c135a7ff15ee9116e54a9df4cc0"
server_key_iv: "daa00f4ea82f62901aad0bb08b111f41"
server_key_version: "encryptionkey@0"
I20260811 07:02:29.334488 1535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:29.352938 1535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:29.357204 1535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:29.357520 1535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:29.358568 1535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:29.360051 1535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:29.360159 1535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:29.360314 1535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:29.360390 1535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:29.396436 1535 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:35089
I20260811 07:02:29.396481 1678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:35089 every 8 connection(s)
I20260811 07:02:29.397907 1535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:29.402514 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 1535
I20260811 07:02:29.402736 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:29.403355 31013 external_mini_cluster.cc:1428] Setting key 629656397055db74c33b447e83f566ea
Aug 11 07:02:29 dist-test-slave-69rg krb5kdc[1265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431749, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:29.423473 1681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:29.400772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:38585 (local address 127.30.73.126:42515)
0811 07:02:29.401309 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:29.401314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:29.402284 (+ 970us) server_negotiation.cc:407] Connection header received
0811 07:02:29.404807 (+ 2523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:29.404813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:29.404896 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:29.405017 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:29.407127 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:29.407914 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:29.410522 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:29.410982 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:29.411093 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:29.415771 (+ 4678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:29.415781 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:29.415789 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:29.415841 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:29.419820 (+ 3979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:29.420598 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:29.420606 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:29.420613 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:29.420797 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:29.421222 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:29.421229 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:29.421235 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:29.421678 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:29.421901 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:29.422631 (+ 730us) server_negotiation.cc:299] Negotiation successful
0811 07:02:29.422916 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":409,"thread_start_us":297,"threads_started":1}
I20260811 07:02:29.424171 1682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:29.401219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:42515 (local address 127.30.73.66:38585)
0811 07:02:29.402081 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:29.402138 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:29.404514 (+ 2376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:29.405223 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:29.405230 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:29.406050 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:29.406898 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:29.406929 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:29.408114 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:29.408122 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:29.410343 (+ 2221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:29.410364 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:29.411244 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:29.411254 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:29.411603 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:29.412397 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:29.412438 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:29.415498 (+ 3060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:29.419974 (+ 4476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:29.419982 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:29.419995 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:29.420447 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:29.420913 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:29.420916 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:29.420918 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:29.421099 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:29.421855 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:29.421867 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:29.422224 (+ 357us) client_negotiation.cc:769] Sending connection context
0811 07:02:29.422477 (+ 253us) client_negotiation.cc:240] Negotiation successful
0811 07:02:29.422889 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":292,"threads_started":1}
I20260811 07:02:29.425782 1679 heartbeater.cc:347] Connected to a master server at 127.30.73.126:42515
I20260811 07:02:29.426147 1679 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:29.426916 1679 heartbeater.cc:511] Master 127.30.73.126:42515 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
I20260811 07:02:29.428494 1319 ts_manager.cc:194] Registered new tserver with Master: e55cea6cb2194ada8a9bc5ca37b6795a (127.30.73.66:35089)
I20260811 07:02:29.429430 1319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:38585
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:02:29.461138 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42515
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:40489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:29.820765 1686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:29.821130 1686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:29.821318 1686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:29.828743 1686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:29.828902 1686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:29.829102 1686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:29.842199 1686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:40489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:29.843587 1686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:29.845024 1686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:29.859927 1696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:29.859910 1694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:29.860054 1691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:29.865974 1686 server_base.cc:1034] running on GCE node
I20260811 07:02:29.866715 1686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:29.867836 1686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:29.869092 1686 hybrid_clock.cc:648] HybridClock initialized: now 1786431749869045 us; error 69 us; skew 500 ppm
I20260811 07:02:29.869506 1686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:29 dist-test-slave-69rg krb5kdc[1265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431749, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:29.873108 1686 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:02:29.874899 1529 heartbeater.cc:503] Master 127.30.73.126:42515 was elected leader, sending a full tablet report...
I20260811 07:02:29.875442 1686 webserver.cc:460] Webserver started at http://127.30.73.67:43809/ using document root <none> and password file <none>
I20260811 07:02:29.876492 1686 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:29.876703 1686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:29.877245 1686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:29.880703 1686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "474dcec7c1de49b886d9e74994a0c4e8"
format_stamp: "Formatted at 2026-08-11 07:02:29 on dist-test-slave-69rg"
server_key: "a75418ba7cfcaa3db3b1a861c2728418"
server_key_iv: "871c696b4979fd1bd7390f0d7ea09d9b"
server_key_version: "encryptionkey@0"
I20260811 07:02:29.881500 1686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "474dcec7c1de49b886d9e74994a0c4e8"
format_stamp: "Formatted at 2026-08-11 07:02:29 on dist-test-slave-69rg"
server_key: "a75418ba7cfcaa3db3b1a861c2728418"
server_key_iv: "871c696b4979fd1bd7390f0d7ea09d9b"
server_key_version: "encryptionkey@0"
I20260811 07:02:29.887050 1686 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 07:02:29.890902 1703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:29.892606 1686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:02:29.892824 1686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "474dcec7c1de49b886d9e74994a0c4e8"
format_stamp: "Formatted at 2026-08-11 07:02:29 on dist-test-slave-69rg"
server_key: "a75418ba7cfcaa3db3b1a861c2728418"
server_key_iv: "871c696b4979fd1bd7390f0d7ea09d9b"
server_key_version: "encryptionkey@0"
I20260811 07:02:29.893064 1686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:29.916239 1686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:29.921574 1686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:29.922019 1686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:29.923239 1686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:29.925091 1686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:29.925231 1686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:29.925387 1686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:29.925472 1686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:29.969687 1686 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:44621
I20260811 07:02:29.969883 1828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:44621 every 8 connection(s)
I20260811 07:02:29.971478 1686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:29.977216 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 1686
I20260811 07:02:29.977478 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:29.978255 31013 external_mini_cluster.cc:1428] Setting key 8d7e329056d68017999b824be858ae32
Aug 11 07:02:29 dist-test-slave-69rg krb5kdc[1265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431749, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:29.998227 1831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:29.974932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:48067 (local address 127.30.73.126:42515)
0811 07:02:29.975510 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:29.975516 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:29.977072 (+ 1556us) server_negotiation.cc:407] Connection header received
0811 07:02:29.980049 (+ 2977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:29.980055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:29.980169 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:29.980279 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:29.982528 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:29.983516 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:29.985196 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:29.985741 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:29.985990 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:29.990238 (+ 4248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:29.990248 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:29.990256 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:29.990316 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:29.994191 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:29.995246 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:29.995251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:29.995253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:29.995396 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:29.995905 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:29.995908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:29.995910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:29.996258 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:29.996391 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:29.997463 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0811 07:02:29.997712 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":275,"threads_started":1}
I20260811 07:02:29.999835 1832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:29.975718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:42515 (local address 127.30.73.67:48067)
0811 07:02:29.976805 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:29.976882 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:29.979652 (+ 2770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:29.980682 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:29.980692 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:29.981430 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:29.982302 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:29.982332 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:29.983675 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:29.983679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:29.985038 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:29.985050 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:29.986084 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:29.986089 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:29.986303 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:29.987081 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:29.987112 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:29.989944 (+ 2832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:29.994384 (+ 4440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:29.994394 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:29.994417 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:29.995102 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:29.995506 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:29.995511 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:29.995515 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:29.995778 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:29.996392 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:29.996401 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:29.996972 (+ 571us) client_negotiation.cc:769] Sending connection context
0811 07:02:29.997351 (+ 379us) client_negotiation.cc:240] Negotiation successful
0811 07:02:29.998108 (+ 757us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":340,"threads_started":1}
I20260811 07:02:30.001935 1829 heartbeater.cc:347] Connected to a master server at 127.30.73.126:42515
I20260811 07:02:30.002404 1829 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:30.003463 1829 heartbeater.cc:511] Master 127.30.73.126:42515 requested a full tablet report, sending...
I20260811 07:02:30.006367 1319 ts_manager.cc:194] Registered new tserver with Master: 474dcec7c1de49b886d9e74994a0c4e8 (127.30.73.67:44621)
I20260811 07:02:30.007933 1319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:48067
I20260811 07:02:30.009562 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:02:30.067137 1831 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:02:30.063195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53074 (local address 127.30.73.126:42515)
0811 07:02:30.063573 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:30.063581 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:30.064094 (+ 513us) server_negotiation.cc:407] Connection header received
0811 07:02:30.064382 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:30.064391 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:30.064525 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:30.064671 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:30.066792 (+ 2121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53074: BlockingRecv error: recv got EOF from 127.0.0.1:53074 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 07:02:30.071346 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 1387
W20260811 07:02:30.075964 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 1387: Not authorized: Client connection negotiation failed: client connection to 127.30.73.65:44739: server requires authentication, but client does not have Kerberos credentials available
I20260811 07:02:30.076259 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 1387
I20260811 07:02:30.104521 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 1535
W20260811 07:02:30.108183 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 1535: Not authorized: Client connection negotiation failed: client connection to 127.30.73.66:35089: server requires authentication, but client does not have Kerberos credentials available
I20260811 07:02:30.108417 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 1535
I20260811 07:02:30.139700 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 1686
W20260811 07:02:30.144347 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 1686: Not authorized: Client connection negotiation failed: client connection to 127.30.73.67:44621: server requires authentication, but client does not have Kerberos credentials available
W20260811 07:02:30.144593 1843 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:02:30.141183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48414 (local address 127.30.73.67:44621)
0811 07:02:30.142301 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:30.142310 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:30.142356 (+ 46us) server_negotiation.cc:407] Connection header received
0811 07:02:30.142472 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:30.142481 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:30.142778 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:30.143036 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:30.144197 (+ 1161us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48414: BlockingRecv error: recv got EOF from 127.0.0.1:48414 (error 108)
Metrics: {"server-negotiator.queue_time_us":900,"thread_start_us":677,"threads_started":1}
I20260811 07:02:30.144711 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 1686
I20260811 07:02:30.174394 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 1280
I20260811 07:02:30.176133 1350 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:30.299703 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 1280
2026-08-11T07:02:30Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4231 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:30 dist-test-slave-69rg krb5kdc[1847](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:30 dist-test-slave-69rg krb5kdc[1847](info): set up 2 sockets
Aug 11 07:02:30 dist-test-slave-69rg krb5kdc[1847](info): commencing operation
krb5kdc: starting...
W20260811 07:02:31.560549 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.002s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:31 dist-test-slave-69rg krb5kdc[1847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:31.806279 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:37305
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:37305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:32.159710 1861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:32.160108 1861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:32.160280 1861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:32.168334 1861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:32.168516 1861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:32.168630 1861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:32.168864 1861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:32.169070 1861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:32.179868 1861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:37305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:37305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:32.181272 1861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:32.182667 1861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:32.195343 1868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:32.195380 1870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:32.195374 1867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:32.196456 1861 server_base.cc:1034] running on GCE node
I20260811 07:02:32.197355 1861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:32.198900 1861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:32.200143 1861 hybrid_clock.cc:648] HybridClock initialized: now 1786431752200091 us; error 39 us; skew 500 ppm
I20260811 07:02:32.200578 1861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:32 dist-test-slave-69rg krb5kdc[1847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431752, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:32.204169 1861 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:32.205636 1861 webserver.cc:460] Webserver started at http://127.30.73.126:42471/ using document root <none> and password file <none>
I20260811 07:02:32.206377 1861 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:32.206486 1861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:32.206760 1861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:32.209703 1861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "cbdf012672c34d428cb5075760ee5506"
format_stamp: "Formatted at 2026-08-11 07:02:32 on dist-test-slave-69rg"
server_key: "0ef5a4351a4201e759a4d8e8ce16ee67"
server_key_iv: "f3ff153865872694a42bd51e7a6dd776"
server_key_version: "encryptionkey@0"
I20260811 07:02:32.210553 1861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "cbdf012672c34d428cb5075760ee5506"
format_stamp: "Formatted at 2026-08-11 07:02:32 on dist-test-slave-69rg"
server_key: "0ef5a4351a4201e759a4d8e8ce16ee67"
server_key_iv: "f3ff153865872694a42bd51e7a6dd776"
server_key_version: "encryptionkey@0"
I20260811 07:02:32.215842 1861 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:32.219419 1878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:32.220834 1861 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:02:32.221033 1861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "cbdf012672c34d428cb5075760ee5506"
format_stamp: "Formatted at 2026-08-11 07:02:32 on dist-test-slave-69rg"
server_key: "0ef5a4351a4201e759a4d8e8ce16ee67"
server_key_iv: "f3ff153865872694a42bd51e7a6dd776"
server_key_version: "encryptionkey@0"
I20260811 07:02:32.221246 1861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:32.239203 1861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:32.244078 1861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:32.244431 1861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:32.266371 1861 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:37305
I20260811 07:02:32.266395 1939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:37305 every 8 connection(s)
I20260811 07:02:32.267936 1861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:32.270304 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 1861
I20260811 07:02:32.270571 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:32.271450 31013 external_mini_cluster.cc:1428] Setting key 24df8e1f30682bcd738ef2c2e43cc44d
I20260811 07:02:32.273247 1940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:02:32 dist-test-slave-69rg krb5kdc[1847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:32.288913 1940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506: Bootstrap starting.
I20260811 07:02:32.292656 1940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:32.294034 1940 log.cc:824] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:32.297729 1940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506: No bootstrap required, opened a new log
I20260811 07:02:32.298411 1943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:32.273730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60566 (local address 127.30.73.126:37305)
0811 07:02:32.274735 (+ 1005us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:32.274749 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:32.274794 (+ 45us) server_negotiation.cc:407] Connection header received
0811 07:02:32.276637 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:32.276663 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:32.277112 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:32.277504 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:32.279598 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:32.281237 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:32.283031 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:32.283760 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:32.283913 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:32.289381 (+ 5468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:32.289391 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:32.289417 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:32.289465 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:32.293203 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:32.294266 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:32.294277 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:32.294290 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:32.294569 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:32.295089 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:32.295097 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:32.295103 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:32.295851 (+ 748us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:32.296099 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:32.296728 (+ 629us) server_negotiation.cc:299] Negotiation successful
0811 07:02:32.297186 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":765,"thread_start_us":447,"threads_started":1}
I20260811 07:02:32.302508 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:02:32.308307 1940 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf012672c34d428cb5075760ee5506" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37305 } }
I20260811 07:02:32.308851 1940 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:32.308974 1940 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbdf012672c34d428cb5075760ee5506, State: Initialized, Role: FOLLOWER
I20260811 07:02:32.309700 1940 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf012672c34d428cb5075760ee5506" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37305 } }
I20260811 07:02:32.310048 1940 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:32.310217 1940 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:32.310401 1940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:32.313696 1940 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf012672c34d428cb5075760ee5506" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37305 } }
I20260811 07:02:32.314352 1940 leader_election.cc:302] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbdf012672c34d428cb5075760ee5506; no voters:
I20260811 07:02:32.315075 1940 leader_election.cc:288] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:32.315204 1946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:32.316735 1946 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [term 1 LEADER]: Becoming Leader. State: Replica: cbdf012672c34d428cb5075760ee5506, State: Running, Role: LEADER
I20260811 07:02:32.317405 1946 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf012672c34d428cb5075760ee5506" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37305 } }
I20260811 07:02:32.317839 1940 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:32.321273 1947 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbdf012672c34d428cb5075760ee5506" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf012672c34d428cb5075760ee5506" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37305 } } }
I20260811 07:02:32.321805 1947 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:32.322714 1949 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbdf012672c34d428cb5075760ee5506. Latest consensus state: current_term: 1 leader_uuid: "cbdf012672c34d428cb5075760ee5506" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf012672c34d428cb5075760ee5506" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37305 } } }
I20260811 07:02:32.323254 1949 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:32.326515 1952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:32.332930 1952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:32.348383 1952 catalog_manager.cc:1347] Generated new cluster ID: f5de96df28d743dea1351dc1bec278f5
I20260811 07:02:32.348637 1952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:32.363616 1968 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:02:32.369848 1952 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:32.371423 1952 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:32.380203 1952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbdf012672c34d428cb5075760ee5506: Generated new TSK 0
I20260811 07:02:32.381217 1943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:32.367501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60576 (local address 127.30.73.126:37305)
0811 07:02:32.367759 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:32.367767 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:32.369640 (+ 1873us) server_negotiation.cc:407] Connection header received
0811 07:02:32.371935 (+ 2295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:32.371941 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:32.372035 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:32.372180 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:32.373761 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:32.374904 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:32.377046 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:32.377732 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:32.377938 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:32.379186 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:32.379198 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:32.379204 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:32.380226 (+ 1022us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:32.380297 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:32.380338 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:32.380465 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:32.380665 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 07:02:32.380777 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:02:32.381307 1952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:02:32.392688 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 1861
I20260811 07:02:32.394207 1935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:32.482990 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 1861
2026-08-11T07:02:32Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2169 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:32 dist-test-slave-69rg krb5kdc[1977](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:32 dist-test-slave-69rg krb5kdc[1977](info): set up 2 sockets
Aug 11 07:02:32 dist-test-slave-69rg krb5kdc[1977](info): commencing operation
krb5kdc: starting...
W20260811 07:02:33.662472 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:33 dist-test-slave-69rg krb5kdc[1977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:33.914419 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44179
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:34.278347 1992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:34.278647 1992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:34.278816 1992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:34.286201 1992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:34.286312 1992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:34.286422 1992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:34.286505 1992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:34.286585 1992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:34.296593 1992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:34.298094 1992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:34.299495 1992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:34.312983 2002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:34.313036 1999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:34.312937 2000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:34.314184 1992 server_base.cc:1034] running on GCE node
I20260811 07:02:34.315075 1992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:34.316883 1992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:34.318146 1992 hybrid_clock.cc:648] HybridClock initialized: now 1786431754318088 us; error 79 us; skew 500 ppm
I20260811 07:02:34.318578 1992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:34 dist-test-slave-69rg krb5kdc[1977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431754, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:34.322057 1992 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:34.324126 1992 webserver.cc:460] Webserver started at http://127.30.73.126:39181/ using document root <none> and password file <none>
I20260811 07:02:34.324870 1992 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:34.324980 1992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:34.325254 1992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:34.329176 1992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "e76f5cb8618e49a7888450c9f535a2bb"
format_stamp: "Formatted at 2026-08-11 07:02:34 on dist-test-slave-69rg"
server_key: "7c647bea2b5efca3ee856cf04b61d5ab"
server_key_iv: "f0d431b17558f5090104fae577832707"
server_key_version: "encryptionkey@0"
I20260811 07:02:34.330116 1992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "e76f5cb8618e49a7888450c9f535a2bb"
format_stamp: "Formatted at 2026-08-11 07:02:34 on dist-test-slave-69rg"
server_key: "7c647bea2b5efca3ee856cf04b61d5ab"
server_key_iv: "f0d431b17558f5090104fae577832707"
server_key_version: "encryptionkey@0"
I20260811 07:02:34.336202 1992 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:02:34.340109 2009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:34.341665 1992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:02:34.342010 1992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "e76f5cb8618e49a7888450c9f535a2bb"
format_stamp: "Formatted at 2026-08-11 07:02:34 on dist-test-slave-69rg"
server_key: "7c647bea2b5efca3ee856cf04b61d5ab"
server_key_iv: "f0d431b17558f5090104fae577832707"
server_key_version: "encryptionkey@0"
I20260811 07:02:34.342206 1992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:34.395994 1992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:34.400992 1992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:34.401335 1992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:34.423146 1992 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:44179
I20260811 07:02:34.423147 2066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:44179 every 8 connection(s)
I20260811 07:02:34.425053 1992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:34.428952 2067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:34.430815 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 1992
I20260811 07:02:34.431051 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:34.431957 31013 external_mini_cluster.cc:1428] Setting key 564e51c00174d689c4af46da614bff81
I20260811 07:02:34.443022 2067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb: Bootstrap starting.
Aug 11 07:02:34 dist-test-slave-69rg krb5kdc[1977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:34.446648 2067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:34.448052 2067 log.cc:824] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:34.452085 2067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb: No bootstrap required, opened a new log
I20260811 07:02:34.457926 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:34.434415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35522 (local address 127.30.73.126:44179)
0811 07:02:34.435250 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:34.435262 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:34.435315 (+ 53us) server_negotiation.cc:407] Connection header received
0811 07:02:34.436911 (+ 1596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:34.436935 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:34.437343 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:34.437753 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:34.439264 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:34.440612 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:34.441961 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:34.442623 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:34.442826 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:34.447648 (+ 4822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:34.447662 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:34.447691 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:34.447746 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:34.451796 (+ 4050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:34.452743 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:34.452762 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:34.452772 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:34.453041 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:34.453840 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:34.453846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:34.453850 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:34.454672 (+ 822us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:34.455029 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:34.455835 (+ 806us) server_negotiation.cc:299] Negotiation successful
0811 07:02:34.456368 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":360,"threads_started":1}
I20260811 07:02:34.462836 2067 raft_consensus.cc:348] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e76f5cb8618e49a7888450c9f535a2bb" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44179 } }
I20260811 07:02:34.463207 2067 raft_consensus.cc:374] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:34.463295 2067 raft_consensus.cc:729] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e76f5cb8618e49a7888450c9f535a2bb, State: Initialized, Role: FOLLOWER
I20260811 07:02:34.463891 2067 consensus_queue.cc:260] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e76f5cb8618e49a7888450c9f535a2bb" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44179 } }
I20260811 07:02:34.464104 2067 raft_consensus.cc:388] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:34.464200 2067 raft_consensus.cc:482] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:34.464334 2067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:34.466661 2067 raft_consensus.cc:504] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e76f5cb8618e49a7888450c9f535a2bb" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44179 } }
I20260811 07:02:34.467252 2067 leader_election.cc:302] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e76f5cb8618e49a7888450c9f535a2bb; no voters:
I20260811 07:02:34.467983 2067 leader_election.cc:288] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:34.468163 2072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:34.468889 2072 raft_consensus.cc:686] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [term 1 LEADER]: Becoming Leader. State: Replica: e76f5cb8618e49a7888450c9f535a2bb, State: Running, Role: LEADER
I20260811 07:02:34.469463 2072 consensus_queue.cc:237] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e76f5cb8618e49a7888450c9f535a2bb" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44179 } }
I20260811 07:02:34.470304 2067 sys_catalog.cc:564] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:34.472342 2075 sys_catalog.cc:455] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e76f5cb8618e49a7888450c9f535a2bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e76f5cb8618e49a7888450c9f535a2bb" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44179 } } }
I20260811 07:02:34.472680 2075 sys_catalog.cc:458] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:34.473556 2081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:34.474779 2076 sys_catalog.cc:455] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader e76f5cb8618e49a7888450c9f535a2bb. Latest consensus state: current_term: 1 leader_uuid: "e76f5cb8618e49a7888450c9f535a2bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e76f5cb8618e49a7888450c9f535a2bb" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44179 } } }
I20260811 07:02:34.475205 2076 sys_catalog.cc:458] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:34.482429 2081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:34.490970 2081 catalog_manager.cc:1347] Generated new cluster ID: 7d993386ca5b46ba9925d9437aef2e21
I20260811 07:02:34.491106 2081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:34.502071 2081 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:34.503443 2081 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:34.515588 2081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e76f5cb8618e49a7888450c9f535a2bb: Generated new TSK 0
I20260811 07:02:34.516498 2081 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:02:34.583284 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44179
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:34.927608 2098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:34.927910 2098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:34.928004 2098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:34.935405 2098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:34.935525 2098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:34.935642 2098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:34.945684 2098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:34.947136 2098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:34.948521 2098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:34.962983 2104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:34.963018 2105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:34.963068 2107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:34.964084 2098 server_base.cc:1034] running on GCE node
I20260811 07:02:34.964735 2098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:34.965864 2098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:34.967093 2098 hybrid_clock.cc:648] HybridClock initialized: now 1786431754967041 us; error 42 us; skew 500 ppm
I20260811 07:02:34.967476 2098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:34 dist-test-slave-69rg krb5kdc[1977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431754, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:34.971381 2098 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:02:34.973141 2098 webserver.cc:460] Webserver started at http://127.30.73.65:43731/ using document root <none> and password file <none>
I20260811 07:02:34.974014 2098 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:34.974174 2098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:34.974540 2098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:34.978024 2098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "43932256feb54911ac70a51a9f39ef0c"
format_stamp: "Formatted at 2026-08-11 07:02:34 on dist-test-slave-69rg"
server_key: "32249910ae5cae2b37c710656d376d85"
server_key_iv: "fde4d12ac55af48dfd7492e01e7424ad"
server_key_version: "encryptionkey@0"
I20260811 07:02:34.978956 2098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "43932256feb54911ac70a51a9f39ef0c"
format_stamp: "Formatted at 2026-08-11 07:02:34 on dist-test-slave-69rg"
server_key: "32249910ae5cae2b37c710656d376d85"
server_key_iv: "fde4d12ac55af48dfd7492e01e7424ad"
server_key_version: "encryptionkey@0"
I20260811 07:02:34.984606 2098 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 07:02:34.988449 2114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:34.989881 2098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:02:34.990064 2098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "43932256feb54911ac70a51a9f39ef0c"
format_stamp: "Formatted at 2026-08-11 07:02:34 on dist-test-slave-69rg"
server_key: "32249910ae5cae2b37c710656d376d85"
server_key_iv: "fde4d12ac55af48dfd7492e01e7424ad"
server_key_version: "encryptionkey@0"
I20260811 07:02:34.990278 2098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:35.027748 2098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:35.033120 2098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:35.033746 2098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:35.035214 2098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:35.036828 2098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:35.036947 2098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:35.037122 2098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:35.037217 2098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:35.074138 2098 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:46799
I20260811 07:02:35.074345 2238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:46799 every 8 connection(s)
I20260811 07:02:35.075641 2098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:35.078778 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 2098
I20260811 07:02:35.078990 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:35.079898 31013 external_mini_cluster.cc:1428] Setting key 180eb33a847684011ded3a4f471d47af
Aug 11 07:02:35 dist-test-slave-69rg krb5kdc[1977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431754, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:35.097864 2241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:35.078501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:57337 (local address 127.30.73.126:44179)
0811 07:02:35.078988 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:35.078993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:35.080161 (+ 1168us) server_negotiation.cc:407] Connection header received
0811 07:02:35.082273 (+ 2112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:35.082279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:35.082370 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:35.082488 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:35.083976 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:35.084705 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:35.086321 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:35.086739 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:35.086881 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:35.090617 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:35.090626 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:35.090634 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:35.090682 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:35.093733 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:35.094876 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:35.094885 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:35.094891 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:35.095053 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:35.095634 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:35.095642 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:35.095648 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:35.096056 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:35.096222 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:35.097021 (+ 799us) server_negotiation.cc:299] Negotiation successful
0811 07:02:35.097316 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":257,"threads_started":1}
I20260811 07:02:35.098558 2243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:35.079224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44179 (local address 127.30.73.65:57337)
0811 07:02:35.080009 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:35.080045 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:35.082002 (+ 1957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:35.082747 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:35.082755 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:35.083247 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:35.083800 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:35.083818 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:35.084870 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:35.084874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:35.086165 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:35.086178 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:35.086974 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:35.086983 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:35.087226 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:35.087940 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:35.087962 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:35.090321 (+ 2359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:35.093909 (+ 3588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:35.093923 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:35.093945 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:35.094708 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:35.095197 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:35.095200 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:35.095202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:35.095480 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:35.096218 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:35.096225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:35.096562 (+ 337us) client_negotiation.cc:769] Sending connection context
0811 07:02:35.096848 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 07:02:35.097249 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":355,"threads_started":1}
I20260811 07:02:35.100335 2239 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44179
I20260811 07:02:35.100678 2239 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:35.101537 2239 heartbeater.cc:511] Master 127.30.73.126:44179 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
I20260811 07:02:35.104025 2028 ts_manager.cc:194] Registered new tserver with Master: 43932256feb54911ac70a51a9f39ef0c (127.30.73.65:46799)
I20260811 07:02:35.105628 2028 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:57337
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:02:35.133931 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44179
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:35.482252 2247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:35.482569 2247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:35.482679 2247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:35.490628 2247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:35.490783 2247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:35.490909 2247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:35.501431 2247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:35.502978 2247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:35.504390 2247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:35.519068 2252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:35.519157 2253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:35.519131 2255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:35.520174 2247 server_base.cc:1034] running on GCE node
I20260811 07:02:35.520798 2247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:35.521994 2247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:35.523207 2247 hybrid_clock.cc:648] HybridClock initialized: now 1786431755523167 us; error 43 us; skew 500 ppm
I20260811 07:02:35.523557 2247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:35 dist-test-slave-69rg krb5kdc[1977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431755, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:35.531512 2247 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:02:35.533344 2247 webserver.cc:460] Webserver started at http://127.30.73.66:42983/ using document root <none> and password file <none>
I20260811 07:02:35.534162 2247 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:35.534317 2247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:35.534667 2247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:35.537990 2247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "e24f785f059449e187debb2fc7d6e9ed"
format_stamp: "Formatted at 2026-08-11 07:02:35 on dist-test-slave-69rg"
server_key: "08e76debfa9840b5a6fcb47a48c3c334"
server_key_iv: "856428ce01c9560f54c810e355fb3fc0"
server_key_version: "encryptionkey@0"
I20260811 07:02:35.538898 2247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "e24f785f059449e187debb2fc7d6e9ed"
format_stamp: "Formatted at 2026-08-11 07:02:35 on dist-test-slave-69rg"
server_key: "08e76debfa9840b5a6fcb47a48c3c334"
server_key_iv: "856428ce01c9560f54c810e355fb3fc0"
server_key_version: "encryptionkey@0"
I20260811 07:02:35.544548 2247 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:35.548508 2265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:35.550191 2247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:02:35.550390 2247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "e24f785f059449e187debb2fc7d6e9ed"
format_stamp: "Formatted at 2026-08-11 07:02:35 on dist-test-slave-69rg"
server_key: "08e76debfa9840b5a6fcb47a48c3c334"
server_key_iv: "856428ce01c9560f54c810e355fb3fc0"
server_key_version: "encryptionkey@0"
I20260811 07:02:35.550611 2247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:35.572505 2247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:35.577363 2247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:35.577728 2247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:35.578830 2247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:35.580221 2247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:35.580332 2247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:35.580475 2247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:35.580549 2247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:35.618798 2247 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:46443
I20260811 07:02:35.618891 2391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:46443 every 8 connection(s)
I20260811 07:02:35.620153 2247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:35.626806 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 2247
I20260811 07:02:35.627017 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:35.627538 31013 external_mini_cluster.cc:1428] Setting key 22cd47c1d0b26a9f8cd69e5062e9e91e
Aug 11 07:02:35 dist-test-slave-69rg krb5kdc[1977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431755, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:35.642306 2395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:35.622693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:47791 (local address 127.30.73.126:44179)
0811 07:02:35.623146 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:35.623150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:35.623948 (+ 798us) server_negotiation.cc:407] Connection header received
0811 07:02:35.625901 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:35.625906 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:35.625999 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:35.626123 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:35.627808 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:35.628788 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:35.630814 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:35.631566 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:35.631733 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:35.635214 (+ 3481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:35.635223 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:35.635231 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:35.635279 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:35.638554 (+ 3275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:35.639646 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:35.639652 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:35.639656 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:35.639822 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:35.640373 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:35.640377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:35.640379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:35.640660 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:35.640781 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:35.641748 (+ 967us) server_negotiation.cc:299] Negotiation successful
0811 07:02:35.642027 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":247,"threads_started":1}
I20260811 07:02:35.643889 2397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:35.623048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44179 (local address 127.30.73.66:47791)
0811 07:02:35.623781 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:35.623826 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:35.625598 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:35.626367 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:35.626376 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:35.626900 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:35.627569 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:35.627589 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:35.628965 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:35.628971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:35.630635 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:35.630649 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:35.631809 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:35.631814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:35.632008 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:35.632731 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:35.632756 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:35.634966 (+ 2210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:35.638735 (+ 3769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:35.638747 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:35.638768 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:35.639488 (+ 720us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:35.639951 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:35.639968 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:35.639975 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:35.640252 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:35.640793 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:35.640804 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:35.641319 (+ 515us) client_negotiation.cc:769] Sending connection context
0811 07:02:35.641646 (+ 327us) client_negotiation.cc:240] Negotiation successful
0811 07:02:35.642361 (+ 715us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":299,"threads_started":1}
I20260811 07:02:35.645488 2393 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44179
I20260811 07:02:35.645895 2393 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:35.646852 2393 heartbeater.cc:511] Master 127.30.73.126:44179 requested a full tablet report, sending...
I20260811 07:02:35.648617 2028 ts_manager.cc:194] Registered new tserver with Master: e24f785f059449e187debb2fc7d6e9ed (127.30.73.66:46443)
I20260811 07:02:35.650013 2028 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:47791
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:02:35.685290 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44179
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:35263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:36.027802 2400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:36.028087 2400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:36.028257 2400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:36.035307 2400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:36.035411 2400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:36.035597 2400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:36.045693 2400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:35263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:36.047252 2400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:36.048628 2400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:36.062881 2406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:36.063037 2409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:36.063468 2405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:36.064364 2400 server_base.cc:1034] running on GCE node
I20260811 07:02:36.065092 2400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:36.066406 2400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:36.067651 2400 hybrid_clock.cc:648] HybridClock initialized: now 1786431756067598 us; error 39 us; skew 500 ppm
I20260811 07:02:36.068049 2400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[1977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431756, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:36.072381 2400 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:02:36.074062 2400 webserver.cc:460] Webserver started at http://127.30.73.67:38395/ using document root <none> and password file <none>
I20260811 07:02:36.074922 2400 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:36.075094 2400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:36.075505 2400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:36.079015 2400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "4232f96c706b40679588aae52c48ea6d"
format_stamp: "Formatted at 2026-08-11 07:02:36 on dist-test-slave-69rg"
server_key: "2d54820fc36fb1bf44bce23f41fdfea9"
server_key_iv: "c050bcf6606e99424a47686ab04eb016"
server_key_version: "encryptionkey@0"
I20260811 07:02:36.079977 2400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "4232f96c706b40679588aae52c48ea6d"
format_stamp: "Formatted at 2026-08-11 07:02:36 on dist-test-slave-69rg"
server_key: "2d54820fc36fb1bf44bce23f41fdfea9"
server_key_iv: "c050bcf6606e99424a47686ab04eb016"
server_key_version: "encryptionkey@0"
I20260811 07:02:36.085773 2400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:02:36.089704 2417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:36.091216 2400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:02:36.091435 2400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "4232f96c706b40679588aae52c48ea6d"
format_stamp: "Formatted at 2026-08-11 07:02:36 on dist-test-slave-69rg"
server_key: "2d54820fc36fb1bf44bce23f41fdfea9"
server_key_iv: "c050bcf6606e99424a47686ab04eb016"
server_key_version: "encryptionkey@0"
I20260811 07:02:36.091665 2400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:36.103101 2400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:36.107398 2400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:36.107717 2400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:36.108724 2400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:36.109102 2239 heartbeater.cc:503] Master 127.30.73.126:44179 was elected leader, sending a full tablet report...
I20260811 07:02:36.110460 2400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:36.110560 2400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:36.110687 2400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:36.110759 2400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:36.145561 2400 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:34565
I20260811 07:02:36.145620 2541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:34565 every 8 connection(s)
I20260811 07:02:36.147166 2400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:36.148998 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 2400
I20260811 07:02:36.149183 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:36.149766 31013 external_mini_cluster.cc:1428] Setting key 077ea825e9459b956e96c8156bd7d483
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[1977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431756, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:36.169278 2545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:36.150376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:37545 (local address 127.30.73.126:44179)
0811 07:02:36.151338 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:36.151345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:36.153911 (+ 2566us) server_negotiation.cc:407] Connection header received
0811 07:02:36.154190 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:36.154195 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:36.154301 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:36.154418 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:36.155998 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.156814 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.158510 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.158920 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.159056 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:36.162566 (+ 3510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:36.162571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:36.162574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:36.162606 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:36.165936 (+ 3330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.166685 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.166690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.166692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.166823 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.167225 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.167228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.167230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.167510 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:36.167628 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:36.168579 (+ 951us) server_negotiation.cc:299] Negotiation successful
0811 07:02:36.168837 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":787,"thread_start_us":623,"threads_started":1}
I20260811 07:02:36.170351 2546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:36.151051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44179 (local address 127.30.73.67:37545)
0811 07:02:36.152011 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:36.152059 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:36.153910 (+ 1851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:36.154696 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:36.154705 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:36.155239 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:36.155825 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:36.155842 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.156980 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.156986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:36.158347 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:36.158364 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.159166 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.159174 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:36.159413 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:36.160072 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:36.160094 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:36.162351 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:36.166062 (+ 3711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:36.166070 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:36.166082 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:36.166533 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:36.166925 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:36.166929 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:36.166931 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:36.167115 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:36.167625 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:36.167630 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:36.168018 (+ 388us) client_negotiation.cc:769] Sending connection context
0811 07:02:36.168382 (+ 364us) client_negotiation.cc:240] Negotiation successful
0811 07:02:36.169049 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":397,"threads_started":1}
I20260811 07:02:36.171849 2542 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44179
I20260811 07:02:36.172139 2542 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:36.172834 2542 heartbeater.cc:511] Master 127.30.73.126:44179 requested a full tablet report, sending...
I20260811 07:02:36.174300 2028 ts_manager.cc:194] Registered new tserver with Master: 4232f96c706b40679588aae52c48ea6d (127.30.73.67:34565)
I20260811 07:02:36.175205 2028 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:37545
I20260811 07:02:36.178154 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[1977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431756, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[1977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431756, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:36.233487 2545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:36.219086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35526 (local address 127.30.73.126:44179)
0811 07:02:36.219308 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:36.219314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:36.219742 (+ 428us) server_negotiation.cc:407] Connection header received
0811 07:02:36.219940 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:36.219944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:36.220016 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:36.220125 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:36.221603 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.222517 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.223781 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.224274 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.224406 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:36.228456 (+ 4050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:36.228469 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:36.228473 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:36.228510 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:36.231272 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.231878 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.231882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.231885 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.232011 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.232333 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.232336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.232338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.232649 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:36.232831 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:36.233088 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 07:02:36.233258 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260811 07:02:36.234169 2028 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:35526
I20260811 07:02:36.235975 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2098
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[1977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431756, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:36.251890 2555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:36.236970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60618 (local address 127.30.73.65:46799)
0811 07:02:36.237598 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:36.237605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:36.237628 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:02:36.237683 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:36.237688 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:36.237938 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:36.238090 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:36.239209 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.240215 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.241342 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.241957 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.242053 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:36.245992 (+ 3939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:36.246012 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:36.246027 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:36.246066 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:36.249043 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.249676 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.249683 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.249685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.249885 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.250318 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.250322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.250325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.250830 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:36.251104 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:36.251390 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 07:02:36.251593 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":327,"threads_started":1}
W20260811 07:02:36.253441 2234 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60618
W20260811 07:02:36.254834 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2098: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:02:36.255131 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 2098
I20260811 07:02:36.275918 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2247
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[1977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431756, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:02:36.292900 2556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:36.276880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48994 (local address 127.30.73.66:46443)
0811 07:02:36.277468 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:36.277475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:36.277501 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:02:36.277567 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:36.277573 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:36.277789 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:36.277993 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:36.279264 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.280372 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.281610 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.282313 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.282430 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:36.286762 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:36.286774 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:36.286788 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:36.286831 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:36.289761 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.290528 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.290536 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.290538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.290674 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.291345 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.291349 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.291351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.291753 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:36.291992 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:36.292376 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 07:02:36.292595 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":290,"threads_started":1}
W20260811 07:02:36.294332 2384 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48994
W20260811 07:02:36.295516 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2247: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:02:36.295675 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 2247
I20260811 07:02:36.317042 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2400
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[1977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431756, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:02:36.334497 2558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:36.318408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48686 (local address 127.30.73.67:34565)
0811 07:02:36.319127 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:36.319137 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:36.319169 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:02:36.319236 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:36.319243 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:36.319468 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:36.319616 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:36.320920 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.322095 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.323443 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:36.324010 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:36.324121 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:36.328709 (+ 4588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:36.328736 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:36.328752 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:36.328788 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:36.331556 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.332259 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.332266 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.332268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.332382 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:36.332752 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:36.332757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:36.332759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:36.333128 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:36.333386 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:36.333665 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 07:02:36.334125 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":367,"threads_started":1}
W20260811 07:02:36.335893 2536 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48686
W20260811 07:02:36.337031 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2400: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:02:36.337237 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 2400
I20260811 07:02:36.361536 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 1992
I20260811 07:02:36.362951 2062 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:36.468180 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 1992
2026-08-11T07:02:36Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3991 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[2562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[2562](info): set up 2 sockets
Aug 11 07:02:36 dist-test-slave-69rg krb5kdc[2562](info): commencing operation
krb5kdc: starting...
W20260811 07:02:37.674769 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:37 dist-test-slave-69rg krb5kdc[2562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:37.919530 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40121
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:40121
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:38.262746 2578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:38.263059 2578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:38.263154 2578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:38.270376 2578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:38.270488 2578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:38.270536 2578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:38.270596 2578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:38.270641 2578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:38.280511 2578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:40121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:38.281894 2578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:38.283237 2578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:38.296977 2585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:38.297035 2586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:38.297006 2588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:38.297405 2578 server_base.cc:1034] running on GCE node
I20260811 07:02:38.299042 2578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:38.300695 2578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:38.301970 2578 hybrid_clock.cc:648] HybridClock initialized: now 1786431758301901 us; error 52 us; skew 500 ppm
I20260811 07:02:38.302397 2578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:38 dist-test-slave-69rg krb5kdc[2562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431758, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:38.306249 2578 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:38.307956 2578 webserver.cc:460] Webserver started at http://127.30.73.126:40895/ using document root <none> and password file <none>
I20260811 07:02:38.308789 2578 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:38.308912 2578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:38.309297 2578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:38.312960 2578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "82df1325ae7442d094a44bac175b41f7"
format_stamp: "Formatted at 2026-08-11 07:02:38 on dist-test-slave-69rg"
server_key: "0ee9ec61513e3a7c8cd757d87bba0504"
server_key_iv: "6a1e768c78b14b7c194480e270647762"
server_key_version: "encryptionkey@0"
I20260811 07:02:38.313923 2578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "82df1325ae7442d094a44bac175b41f7"
format_stamp: "Formatted at 2026-08-11 07:02:38 on dist-test-slave-69rg"
server_key: "0ee9ec61513e3a7c8cd757d87bba0504"
server_key_iv: "6a1e768c78b14b7c194480e270647762"
server_key_version: "encryptionkey@0"
I20260811 07:02:38.319798 2578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260811 07:02:38.323896 2595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:38.325477 2578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:02:38.325663 2578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "82df1325ae7442d094a44bac175b41f7"
format_stamp: "Formatted at 2026-08-11 07:02:38 on dist-test-slave-69rg"
server_key: "0ee9ec61513e3a7c8cd757d87bba0504"
server_key_iv: "6a1e768c78b14b7c194480e270647762"
server_key_version: "encryptionkey@0"
I20260811 07:02:38.325964 2578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:38.362188 2578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:38.367339 2578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:38.367769 2578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:38.388862 2578 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:40121
I20260811 07:02:38.388897 2652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:40121 every 8 connection(s)
I20260811 07:02:38.390741 2578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:38.393136 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 2578
I20260811 07:02:38.393414 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:38.394348 31013 external_mini_cluster.cc:1428] Setting key 24c3c64b7b141056a6fd7df251902f2e
I20260811 07:02:38.396205 2653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:02:38 dist-test-slave-69rg krb5kdc[2562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:38.411911 2653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7: Bootstrap starting.
I20260811 07:02:38.416081 2653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:38.417244 2653 log.cc:824] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:38.420380 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:38.396905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47988 (local address 127.30.73.126:40121)
0811 07:02:38.397782 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:38.397794 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:38.397889 (+ 95us) server_negotiation.cc:407] Connection header received
0811 07:02:38.399569 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:38.399591 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:38.400015 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:38.400438 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:38.402531 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:38.403937 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:38.405744 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:38.406581 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:38.406719 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:38.411754 (+ 5035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:38.411764 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:38.411782 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:38.411833 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:38.415642 (+ 3809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:38.416679 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:38.416688 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:38.416696 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:38.416893 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:38.417336 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:38.417340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:38.417342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:38.418077 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:38.418428 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:38.418897 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 07:02:38.419361 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":421,"threads_started":1}
I20260811 07:02:38.420694 2653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7: No bootstrap required, opened a new log
I20260811 07:02:38.429119 2653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82df1325ae7442d094a44bac175b41f7" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40121 } }
I20260811 07:02:38.429644 2653 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:38.429768 2653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82df1325ae7442d094a44bac175b41f7, State: Initialized, Role: FOLLOWER
I20260811 07:02:38.430461 2653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82df1325ae7442d094a44bac175b41f7" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40121 } }
I20260811 07:02:38.430764 2653 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:38.430924 2653 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:38.431113 2653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:38.433730 2653 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82df1325ae7442d094a44bac175b41f7" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40121 } }
I20260811 07:02:38.434473 2653 leader_election.cc:302] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82df1325ae7442d094a44bac175b41f7; no voters:
I20260811 07:02:38.435283 2653 leader_election.cc:288] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:38.435382 2658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:38.436836 2658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [term 1 LEADER]: Becoming Leader. State: Replica: 82df1325ae7442d094a44bac175b41f7, State: Running, Role: LEADER
I20260811 07:02:38.437403 2658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82df1325ae7442d094a44bac175b41f7" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40121 } }
I20260811 07:02:38.437891 2653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:38.440546 2660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82df1325ae7442d094a44bac175b41f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82df1325ae7442d094a44bac175b41f7" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40121 } } }
I20260811 07:02:38.441102 2660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:38.441586 2661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82df1325ae7442d094a44bac175b41f7. Latest consensus state: current_term: 1 leader_uuid: "82df1325ae7442d094a44bac175b41f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82df1325ae7442d094a44bac175b41f7" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40121 } } }
I20260811 07:02:38.441946 2661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:38.442514 2668 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:38.449398 2668 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:38.462648 2668 catalog_manager.cc:1347] Generated new cluster ID: cebe97ba0b0946f78bec5d40a07c5f4d
I20260811 07:02:38.462783 2668 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:38.503629 2668 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:38.504987 2668 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:38.516295 2668 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82df1325ae7442d094a44bac175b41f7: Generated new TSK 0
I20260811 07:02:38.517237 2668 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:02:38.596262 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40121
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:38.966329 2681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:38.966621 2681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:38.966725 2681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:38.974076 2681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:38.974196 2681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:38.974313 2681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:38.984611 2681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:38.986073 2681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:38.987479 2681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:39.004657 2688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:39.004743 2689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:39.004769 2691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:39.006016 2681 server_base.cc:1034] running on GCE node
I20260811 07:02:39.006774 2681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:39.007854 2681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:39.009078 2681 hybrid_clock.cc:648] HybridClock initialized: now 1786431759009027 us; error 41 us; skew 500 ppm
I20260811 07:02:39.009454 2681 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:39 dist-test-slave-69rg krb5kdc[2562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431759, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:39.013054 2681 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:02:39.014878 2681 webserver.cc:460] Webserver started at http://127.30.73.65:34827/ using document root <none> and password file <none>
I20260811 07:02:39.015635 2681 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:39.015792 2681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:39.016141 2681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:39.019510 2681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "afb893065f4c429391a31b620733b200"
format_stamp: "Formatted at 2026-08-11 07:02:39 on dist-test-slave-69rg"
server_key: "3992adbd948562ec002a0ffb9ad6ae2a"
server_key_iv: "38a4df7f4062c96ab4c6d4d408569e55"
server_key_version: "encryptionkey@0"
I20260811 07:02:39.020844 2681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "afb893065f4c429391a31b620733b200"
format_stamp: "Formatted at 2026-08-11 07:02:39 on dist-test-slave-69rg"
server_key: "3992adbd948562ec002a0ffb9ad6ae2a"
server_key_iv: "38a4df7f4062c96ab4c6d4d408569e55"
server_key_version: "encryptionkey@0"
I20260811 07:02:39.027073 2681 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 07:02:39.030994 2699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:39.032440 2681 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:02:39.032639 2681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "afb893065f4c429391a31b620733b200"
format_stamp: "Formatted at 2026-08-11 07:02:39 on dist-test-slave-69rg"
server_key: "3992adbd948562ec002a0ffb9ad6ae2a"
server_key_iv: "38a4df7f4062c96ab4c6d4d408569e55"
server_key_version: "encryptionkey@0"
I20260811 07:02:39.032915 2681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:39.056094 2681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:39.061080 2681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:39.061411 2681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:39.062520 2681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:39.064003 2681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:39.064113 2681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:39.064261 2681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:39.064339 2681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:39.103865 2681 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:42313
I20260811 07:02:39.103962 2823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:42313 every 8 connection(s)
I20260811 07:02:39.105237 2681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:39.115345 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 2681
I20260811 07:02:39.115585 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:39.116375 31013 external_mini_cluster.cc:1428] Setting key 13b88797beaf48c62a0025d1b0fc8400
Aug 11 07:02:39 dist-test-slave-69rg krb5kdc[2562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431759, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:39.128955 2826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:39.108062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:46119 (local address 127.30.73.126:40121)
0811 07:02:39.108553 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:39.108558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:39.109593 (+ 1035us) server_negotiation.cc:407] Connection header received
0811 07:02:39.111688 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:39.111694 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:39.111804 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:39.111926 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:39.113433 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:39.114264 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:39.116061 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:39.116750 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:39.116907 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:39.120892 (+ 3985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:39.120902 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:39.120909 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:39.120961 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:39.125201 (+ 4240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:39.126234 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:39.126243 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:39.126249 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:39.126411 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:39.126965 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:39.126973 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:39.126976 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:39.127301 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:39.127420 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:39.128484 (+ 1064us) server_negotiation.cc:299] Negotiation successful
0811 07:02:39.128671 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":250,"threads_started":1}
I20260811 07:02:39.130662 2827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:39.108631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40121 (local address 127.30.73.65:46119)
0811 07:02:39.109408 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:39.109468 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:39.111403 (+ 1935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:39.112172 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:39.112180 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:39.112696 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:39.113249 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:39.113272 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:39.114437 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:39.114442 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:39.115872 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:39.115886 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:39.116984 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:39.116989 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:39.117303 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:39.118108 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:39.118131 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:39.120560 (+ 2429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:39.125406 (+ 4846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:39.125415 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:39.125432 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:39.126046 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:39.126556 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:39.126560 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:39.126563 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:39.126822 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:39.127455 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:39.127468 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:39.128007 (+ 539us) client_negotiation.cc:769] Sending connection context
0811 07:02:39.128379 (+ 372us) client_negotiation.cc:240] Negotiation successful
0811 07:02:39.129031 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":304,"threads_started":1}
I20260811 07:02:39.132361 2824 heartbeater.cc:347] Connected to a master server at 127.30.73.126:40121
I20260811 07:02:39.132690 2824 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:39.133432 2824 heartbeater.cc:511] Master 127.30.73.126:40121 requested a full tablet report, sending...
I20260811 07:02:39.135663 2615 ts_manager.cc:194] Registered new tserver with Master: afb893065f4c429391a31b620733b200 (127.30.73.65:42313)
I20260811 07:02:39.137406 2615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:46119
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:02:39.174301 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40121
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:39.512414 2830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:39.512750 2830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:39.512925 2830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:39.520571 2830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:39.520759 2830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:39.520938 2830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:39.531913 2830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:39.533461 2830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:39.534934 2830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:39.549573 2835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:39.549548 2836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:39.549494 2839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:39.550356 2830 server_base.cc:1034] running on GCE node
I20260811 07:02:39.550983 2830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:39.551963 2830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:39.553171 2830 hybrid_clock.cc:648] HybridClock initialized: now 1786431759553112 us; error 50 us; skew 500 ppm
I20260811 07:02:39.553526 2830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:39 dist-test-slave-69rg krb5kdc[2562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431759, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:39.556983 2830 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:02:39.558646 2830 webserver.cc:460] Webserver started at http://127.30.73.66:37953/ using document root <none> and password file <none>
I20260811 07:02:39.559305 2830 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:39.559412 2830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:39.559703 2830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:39.562752 2830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "08d5857c92ba459685a3d600bc8e24d0"
format_stamp: "Formatted at 2026-08-11 07:02:39 on dist-test-slave-69rg"
server_key: "d08b3293e4fa309fe923c1045414ae1a"
server_key_iv: "792431f36da9bd4bbe5ebc5dad149af2"
server_key_version: "encryptionkey@0"
I20260811 07:02:39.563493 2830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "08d5857c92ba459685a3d600bc8e24d0"
format_stamp: "Formatted at 2026-08-11 07:02:39 on dist-test-slave-69rg"
server_key: "d08b3293e4fa309fe923c1045414ae1a"
server_key_iv: "792431f36da9bd4bbe5ebc5dad149af2"
server_key_version: "encryptionkey@0"
I20260811 07:02:39.568877 2830 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:02:39.572453 2847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:39.573793 2830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:02:39.574054 2830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "08d5857c92ba459685a3d600bc8e24d0"
format_stamp: "Formatted at 2026-08-11 07:02:39 on dist-test-slave-69rg"
server_key: "d08b3293e4fa309fe923c1045414ae1a"
server_key_iv: "792431f36da9bd4bbe5ebc5dad149af2"
server_key_version: "encryptionkey@0"
I20260811 07:02:39.574297 2830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:39.593621 2830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:39.598273 2830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:39.598591 2830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:39.599690 2830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:39.601058 2830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:39.601138 2830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:39.601226 2830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:39.601279 2830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:39.636883 2830 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:33601
I20260811 07:02:39.637003 2972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:33601 every 8 connection(s)
I20260811 07:02:39.638437 2830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:39.648160 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 2830
I20260811 07:02:39.648370 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:39.648864 31013 external_mini_cluster.cc:1428] Setting key faa118b9ced01ab5c309eb2e7e3e8430
Aug 11 07:02:39 dist-test-slave-69rg krb5kdc[2562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431759, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:39.659339 2975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:39.641025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:35301 (local address 127.30.73.126:40121)
0811 07:02:39.641466 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:39.641471 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:39.642427 (+ 956us) server_negotiation.cc:407] Connection header received
0811 07:02:39.644291 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:39.644296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:39.644395 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:39.644514 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:39.646018 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:39.646729 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:39.648585 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:39.649103 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:39.649210 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:39.653246 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:39.653252 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:39.653256 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:39.653289 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:39.656056 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:39.656815 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:39.656821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:39.656824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:39.656992 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:39.657448 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:39.657454 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:39.657457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:39.657757 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:39.657949 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:39.658669 (+ 720us) server_negotiation.cc:299] Negotiation successful
0811 07:02:39.658903 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":235,"threads_started":1}
I20260811 07:02:39.660367 2976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:39.641527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40121 (local address 127.30.73.66:35301)
0811 07:02:39.642270 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:39.642306 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:39.644011 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:39.644750 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:39.644758 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:39.645268 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:39.645800 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:39.645864 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:39.646891 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:39.646903 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:39.648435 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:39.648453 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:39.649354 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:39.649362 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:39.649617 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:39.650414 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:39.650441 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:39.652989 (+ 2548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:39.656201 (+ 3212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:39.656210 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:39.656228 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:39.656669 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:39.657100 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:39.657105 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:39.657108 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:39.657316 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:39.657918 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:39.657927 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:39.658297 (+ 370us) client_negotiation.cc:769] Sending connection context
0811 07:02:39.658575 (+ 278us) client_negotiation.cc:240] Negotiation successful
0811 07:02:39.659145 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":329,"threads_started":1}
I20260811 07:02:39.661890 2973 heartbeater.cc:347] Connected to a master server at 127.30.73.126:40121
I20260811 07:02:39.662240 2973 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:39.663131 2973 heartbeater.cc:511] Master 127.30.73.126:40121 requested a full tablet report, sending...
I20260811 07:02:39.664866 2615 ts_manager.cc:194] Registered new tserver with Master: 08d5857c92ba459685a3d600bc8e24d0 (127.30.73.66:33601)
I20260811 07:02:39.666195 2615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:35301
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:02:39.702296 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40121
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:40.053434 2979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:40.053742 2979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:40.053942 2979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:40.061726 2979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:40.061925 2979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:40.062183 2979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:40.074137 2979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:40.075522 2979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:40.076901 2979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:40.091070 2987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:40.091166 2986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:40.091172 2990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:40.092118 2979 server_base.cc:1034] running on GCE node
I20260811 07:02:40.092813 2979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:40.094023 2979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:40.095252 2979 hybrid_clock.cc:648] HybridClock initialized: now 1786431760095198 us; error 46 us; skew 500 ppm
I20260811 07:02:40.095642 2979 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[2562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431760, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:40.099231 2979 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:02:40.100804 2979 webserver.cc:460] Webserver started at http://127.30.73.67:33509/ using document root <none> and password file <none>
I20260811 07:02:40.101519 2979 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:40.101675 2979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:40.102068 2979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:40.105167 2979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "2b8ca3f225184427a4eb82c6910ffbe8"
format_stamp: "Formatted at 2026-08-11 07:02:40 on dist-test-slave-69rg"
server_key: "04ef5c15014307d55cc0f3342c4db5e5"
server_key_iv: "7bf293b2e0e380bf42c3e401d67e8d79"
server_key_version: "encryptionkey@0"
I20260811 07:02:40.106029 2979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "2b8ca3f225184427a4eb82c6910ffbe8"
format_stamp: "Formatted at 2026-08-11 07:02:40 on dist-test-slave-69rg"
server_key: "04ef5c15014307d55cc0f3342c4db5e5"
server_key_iv: "7bf293b2e0e380bf42c3e401d67e8d79"
server_key_version: "encryptionkey@0"
I20260811 07:02:40.111295 2979 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 07:02:40.115121 2998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:40.116506 2979 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 07:02:40.116727 2979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "2b8ca3f225184427a4eb82c6910ffbe8"
format_stamp: "Formatted at 2026-08-11 07:02:40 on dist-test-slave-69rg"
server_key: "04ef5c15014307d55cc0f3342c4db5e5"
server_key_iv: "7bf293b2e0e380bf42c3e401d67e8d79"
server_key_version: "encryptionkey@0"
I20260811 07:02:40.116961 2979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:40.136695 2979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:40.140980 2824 heartbeater.cc:503] Master 127.30.73.126:40121 was elected leader, sending a full tablet report...
I20260811 07:02:40.142516 2979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:40.142881 2979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:40.144122 2979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:40.145702 2979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:40.145810 2979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:40.146003 2979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:40.146081 2979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:40.185261 2979 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:44185
I20260811 07:02:40.185354 3124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:44185 every 8 connection(s)
I20260811 07:02:40.186627 2979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:40.186937 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 2979
I20260811 07:02:40.187165 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:40.187610 31013 external_mini_cluster.cc:1428] Setting key 2ec5763f2b692dff76ead91e06679fcf
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[2562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431760, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:40.210386 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:40.190632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:37991 (local address 127.30.73.126:40121)
0811 07:02:40.191136 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:40.191140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:40.192232 (+ 1092us) server_negotiation.cc:407] Connection header received
0811 07:02:40.194216 (+ 1984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:40.194222 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:40.194336 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:40.194459 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:40.196047 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.196825 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.198556 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.198968 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.199119 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:40.203174 (+ 4055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:40.203180 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:40.203184 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:40.203223 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:40.206821 (+ 3598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.207747 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.207752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.207754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.207891 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.208397 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.208401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.208404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.208705 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:40.208828 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:40.209751 (+ 923us) server_negotiation.cc:299] Negotiation successful
0811 07:02:40.210075 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":253,"threads_started":1}
I20260811 07:02:40.211802 3128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:40.191317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40121 (local address 127.30.73.67:37991)
0811 07:02:40.192071 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:40.192121 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:40.193940 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:40.194720 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:40.194728 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:40.195277 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:40.195868 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:40.195886 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.197000 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.197004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:40.198402 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:40.198415 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.199232 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.199239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:40.199484 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:40.200256 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:40.200284 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:40.202878 (+ 2594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:40.207016 (+ 4138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:40.207026 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:40.207043 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:40.207592 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:40.208028 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:40.208032 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:40.208035 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:40.208256 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:40.208843 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:40.208849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:40.209287 (+ 438us) client_negotiation.cc:769] Sending connection context
0811 07:02:40.209558 (+ 271us) client_negotiation.cc:240] Negotiation successful
0811 07:02:40.210601 (+ 1043us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":299,"threads_started":1}
I20260811 07:02:40.213539 3125 heartbeater.cc:347] Connected to a master server at 127.30.73.126:40121
I20260811 07:02:40.213940 3125 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:40.214761 3125 heartbeater.cc:511] Master 127.30.73.126:40121 requested a full tablet report, sending...
I20260811 07:02:40.216534 2615 ts_manager.cc:194] Registered new tserver with Master: 2b8ca3f225184427a4eb82c6910ffbe8 (127.30.73.67:44185)
I20260811 07:02:40.217519 2615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:37991
I20260811 07:02:40.218211 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[2562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[2562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:40.278529 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:40.261596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38672 (local address 127.30.73.65:42313)
0811 07:02:40.262247 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:40.262254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:40.262282 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:02:40.262346 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:40.262353 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:40.262573 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:40.262730 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:40.264227 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.265278 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.266724 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.267439 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.267563 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:40.272010 (+ 4447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:40.272025 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:40.272043 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:40.272091 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:40.275241 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.275987 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.275996 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.275998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.276154 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.276593 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.276598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.276600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.277096 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:40.277350 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:40.277730 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 07:02:40.278055 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":356,"threads_started":1}
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[2562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:40.301680 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:40.283670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41010 (local address 127.30.73.126:40121)
0811 07:02:40.283912 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:40.283919 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:40.284050 (+ 131us) server_negotiation.cc:407] Connection header received
0811 07:02:40.284304 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:40.284308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:40.284406 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:40.284518 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:40.285879 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.286615 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.287872 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.288282 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.288423 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:40.294033 (+ 5610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:40.294041 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:40.294045 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:40.294111 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:40.297775 (+ 3664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.299171 (+ 1396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.299180 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.299184 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.299431 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.299954 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.299959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.299962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.300360 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:40.300654 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:40.301032 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 07:02:40.301345 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
W20260811 07:02:40.302369 2615 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41010
I20260811 07:02:40.303486 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2681
I20260811 07:02:40.318440 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:40.304465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38682 (local address 127.30.73.65:42313)
0811 07:02:40.304808 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:40.304814 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:40.305027 (+ 213us) server_negotiation.cc:407] Connection header received
0811 07:02:40.305152 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:40.305156 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:40.305257 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:40.305345 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:40.306783 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.307537 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.308843 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.309299 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.309411 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:40.312529 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:40.312534 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:40.312538 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:40.312575 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:40.315685 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.316456 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.316461 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.316464 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.316612 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.317002 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.317006 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.317008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.317292 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:40.317474 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:40.317958 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 07:02:40.318148 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175}
I20260811 07:02:40.319190 2819 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:40.410178 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 2681
I20260811 07:02:40.431728 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2830
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[2562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:02:40.449389 3141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:40.432779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45680 (local address 127.30.73.66:33601)
0811 07:02:40.433369 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:40.433377 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:40.433403 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:02:40.433472 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:40.433478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:40.433689 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:40.433904 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:40.435182 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.436241 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.437532 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.438246 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.438398 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:40.443003 (+ 4605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:40.443018 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:40.443035 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:40.443075 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:40.446652 (+ 3577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.447404 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.447412 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.447414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.447554 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.447926 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.447929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.447931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.448313 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:40.448556 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:40.448845 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 07:02:40.449053 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":326,"threads_started":1}
I20260811 07:02:40.450793 2968 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:40.538573 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 2830
I20260811 07:02:40.560176 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2979
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[2562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:02:40.582631 3143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:40.561451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49820 (local address 127.30.73.67:44185)
0811 07:02:40.562126 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:40.562133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:40.562166 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:02:40.562238 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:40.562246 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:40.562464 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:40.562647 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:40.564045 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.565085 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.566480 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:40.567099 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:40.567247 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:40.576772 (+ 9525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:40.576791 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:40.576809 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:40.576850 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:40.579684 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.580419 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.580427 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.580429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.580552 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:40.580957 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:40.580962 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:40.580966 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:40.581335 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:40.581663 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:40.581999 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 07:02:40.582284 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":291,"threads_started":1}
I20260811 07:02:40.584049 3118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:40.669873 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 2979
I20260811 07:02:40.691401 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 2578
I20260811 07:02:40.692782 2648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:40.801534 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 2578
2026-08-11T07:02:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4336 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[3148](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[3148](info): set up 2 sockets
Aug 11 07:02:40 dist-test-slave-69rg krb5kdc[3148](info): commencing operation
krb5kdc: starting...
W20260811 07:02:42.004649 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:42 dist-test-slave-69rg krb5kdc[3148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:42.287880 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:34901
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:34901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:42.645073 3164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:42.645375 3164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:42.645469 3164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:42.652770 3164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:42.652882 3164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:42.652930 3164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:42.652987 3164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:42.653036 3164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:42.662922 3164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:34901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:34901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:42.664179 3164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:42.665421 3164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:42.677285 3169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:42.677320 3170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:42.677338 3173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:42.678056 3164 server_base.cc:1034] running on GCE node
I20260811 07:02:42.678894 3164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:42.680321 3164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:42.681576 3164 hybrid_clock.cc:648] HybridClock initialized: now 1786431762681537 us; error 62 us; skew 500 ppm
I20260811 07:02:42.682039 3164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:42 dist-test-slave-69rg krb5kdc[3148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431762, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:42.685303 3164 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:42.686607 3164 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:42.686749 3164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:42.687079 3164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:42.690179 3164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "f70f9f5bfcc34a6ea11d804f614a57c8"
format_stamp: "Formatted at 2026-08-11 07:02:42 on dist-test-slave-69rg"
server_key: "445498b3f8abf9337e478c4dfd25fe8d"
server_key_iv: "bc9488956d70d8b47ada3c83120b3b96"
server_key_version: "encryptionkey@0"
I20260811 07:02:42.691011 3164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "f70f9f5bfcc34a6ea11d804f614a57c8"
format_stamp: "Formatted at 2026-08-11 07:02:42 on dist-test-slave-69rg"
server_key: "445498b3f8abf9337e478c4dfd25fe8d"
server_key_iv: "bc9488956d70d8b47ada3c83120b3b96"
server_key_version: "encryptionkey@0"
I20260811 07:02:42.696151 3164 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:42.699659 3181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:42.700995 3164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:02:42.701231 3164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "f70f9f5bfcc34a6ea11d804f614a57c8"
format_stamp: "Formatted at 2026-08-11 07:02:42 on dist-test-slave-69rg"
server_key: "445498b3f8abf9337e478c4dfd25fe8d"
server_key_iv: "bc9488956d70d8b47ada3c83120b3b96"
server_key_version: "encryptionkey@0"
I20260811 07:02:42.701463 3164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:42.722160 3164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:42.726570 3164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:42.726855 3164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:42.746156 3164 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:34901
I20260811 07:02:42.746097 3242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:34901 every 8 connection(s)
I20260811 07:02:42.747112 3164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:42.750882 3244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:42.753459 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 3164
I20260811 07:02:42.753710 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:42.754431 31013 external_mini_cluster.cc:1428] Setting key 6e7eb299d281d319546da667d70fd4a7
I20260811 07:02:42.763559 3244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8: Bootstrap starting.
I20260811 07:02:42.767599 3244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:42.769025 3244 log.cc:824] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:02:42 dist-test-slave-69rg krb5kdc[3148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:42.772059 3244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8: No bootstrap required, opened a new log
I20260811 07:02:42.778131 3247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:42.756437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49318 (local address 127.30.73.126:34901)
0811 07:02:42.757291 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:42.757303 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:42.757344 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:02:42.759210 (+ 1866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:42.759234 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:42.759725 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:42.760078 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:42.762072 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:42.763396 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:42.765181 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:42.765984 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:42.766131 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:42.770831 (+ 4700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:42.770840 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:42.770854 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:42.770895 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:42.774119 (+ 3224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:42.774800 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:42.774819 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:42.774825 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:42.774989 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:42.775364 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:42.775376 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:42.775383 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:42.775913 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:42.776251 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:42.776650 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 07:02:42.777066 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":382,"threads_started":1}
I20260811 07:02:42.780094 3244 raft_consensus.cc:348] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70f9f5bfcc34a6ea11d804f614a57c8" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34901 } }
I20260811 07:02:42.780478 3244 raft_consensus.cc:374] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:42.780606 3244 raft_consensus.cc:729] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f70f9f5bfcc34a6ea11d804f614a57c8, State: Initialized, Role: FOLLOWER
I20260811 07:02:42.781210 3244 consensus_queue.cc:260] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70f9f5bfcc34a6ea11d804f614a57c8" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34901 } }
I20260811 07:02:42.781427 3244 raft_consensus.cc:388] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:42.781522 3244 raft_consensus.cc:482] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:42.781649 3244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:42.783785 3244 raft_consensus.cc:504] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70f9f5bfcc34a6ea11d804f614a57c8" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34901 } }
I20260811 07:02:42.784224 3244 leader_election.cc:302] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f70f9f5bfcc34a6ea11d804f614a57c8; no voters:
I20260811 07:02:42.784771 3244 leader_election.cc:288] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:42.784942 3249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:42.785657 3249 raft_consensus.cc:686] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [term 1 LEADER]: Becoming Leader. State: Replica: f70f9f5bfcc34a6ea11d804f614a57c8, State: Running, Role: LEADER
I20260811 07:02:42.786228 3249 consensus_queue.cc:237] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70f9f5bfcc34a6ea11d804f614a57c8" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34901 } }
I20260811 07:02:42.787043 3244 sys_catalog.cc:564] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:42.789162 3251 sys_catalog.cc:455] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f70f9f5bfcc34a6ea11d804f614a57c8. Latest consensus state: current_term: 1 leader_uuid: "f70f9f5bfcc34a6ea11d804f614a57c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70f9f5bfcc34a6ea11d804f614a57c8" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34901 } } }
I20260811 07:02:42.789162 3250 sys_catalog.cc:455] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f70f9f5bfcc34a6ea11d804f614a57c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70f9f5bfcc34a6ea11d804f614a57c8" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34901 } } }
I20260811 07:02:42.789620 3250 sys_catalog.cc:458] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:42.790300 3251 sys_catalog.cc:458] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:42.791451 3254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:42.796947 3254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:42.806516 3254 catalog_manager.cc:1347] Generated new cluster ID: 395ced462e9c4bf1878fdd30a095607e
I20260811 07:02:42.806643 3254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:42.820411 3254 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:42.821792 3254 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:42.829495 3254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8: Generated new TSK 0
I20260811 07:02:42.830521 3254 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:02:42.890393 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:34901
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:43.238786 3271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:43.239106 3271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:43.239279 3271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:43.246889 3271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:43.247010 3271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:43.247190 3271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:43.257345 3271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:34901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:43.258785 3271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:43.260145 3271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:43.274098 3277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:43.274183 3276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:43.274165 3281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:43.275225 3271 server_base.cc:1034] running on GCE node
I20260811 07:02:43.275923 3271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:43.276922 3271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:43.278204 3271 hybrid_clock.cc:648] HybridClock initialized: now 1786431763278107 us; error 68 us; skew 500 ppm
I20260811 07:02:43.278589 3271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:43 dist-test-slave-69rg krb5kdc[3148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431763, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:43.282235 3271 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:02:43.283622 3271 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:43.283730 3271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:43.284102 3271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:43.287266 3271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "618927c3719642bcbf247ca126716bdc"
format_stamp: "Formatted at 2026-08-11 07:02:43 on dist-test-slave-69rg"
server_key: "d1422d1b3924ddeaaec12a495f56f94e"
server_key_iv: "06abf905bb7922f3d2d37e5c6b839d24"
server_key_version: "encryptionkey@0"
I20260811 07:02:43.288115 3271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "618927c3719642bcbf247ca126716bdc"
format_stamp: "Formatted at 2026-08-11 07:02:43 on dist-test-slave-69rg"
server_key: "d1422d1b3924ddeaaec12a495f56f94e"
server_key_iv: "06abf905bb7922f3d2d37e5c6b839d24"
server_key_version: "encryptionkey@0"
I20260811 07:02:43.293989 3271 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:02:43.297616 3287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:43.299086 3271 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:02:43.299273 3271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "618927c3719642bcbf247ca126716bdc"
format_stamp: "Formatted at 2026-08-11 07:02:43 on dist-test-slave-69rg"
server_key: "d1422d1b3924ddeaaec12a495f56f94e"
server_key_iv: "06abf905bb7922f3d2d37e5c6b839d24"
server_key_version: "encryptionkey@0"
I20260811 07:02:43.299479 3271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:43.314610 3271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:43.319147 3271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:43.319451 3271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:43.320614 3271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:43.322464 3271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:43.322559 3271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:43.322721 3271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:43.322808 3271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:43.361310 3271 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:33717
I20260811 07:02:43.361370 3411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:33717 every 8 connection(s)
I20260811 07:02:43.362314 3271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:43.365417 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 3271
I20260811 07:02:43.365657 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:43.366364 31013 external_mini_cluster.cc:1428] Setting key fb680731130ef7c084eb0063757cd364
Aug 11 07:02:43 dist-test-slave-69rg krb5kdc[3148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431763, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:43.383884 3414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:43.364994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:45723 (local address 127.30.73.126:34901)
0811 07:02:43.365547 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:43.365555 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:43.366795 (+ 1240us) server_negotiation.cc:407] Connection header received
0811 07:02:43.368704 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:43.368710 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:43.368794 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:43.368967 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:43.370594 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:43.371775 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:43.373365 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:43.374100 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:43.374261 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:43.377864 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:43.377872 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:43.377880 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:43.377945 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:43.380612 (+ 2667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:43.381388 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:43.381394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:43.381398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:43.381530 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:43.382042 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:43.382047 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:43.382051 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:43.382331 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:43.382509 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:43.383244 (+ 735us) server_negotiation.cc:299] Negotiation successful
0811 07:02:43.383501 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":261,"threads_started":1}
I20260811 07:02:43.384955 3416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:43.365624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34901 (local address 127.30.73.65:45723)
0811 07:02:43.366598 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:43.366644 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:43.368386 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:43.369177 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:43.369186 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:43.369745 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:43.370410 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:43.370428 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:43.371950 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:43.371954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:43.373191 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:43.373204 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:43.374357 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:43.374363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:43.374554 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:43.375302 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:43.375332 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:43.377554 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:43.380772 (+ 3218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:43.380781 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:43.380798 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:43.381251 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:43.381649 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:43.381654 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:43.381657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:43.381926 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:43.382466 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:43.382473 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:43.382851 (+ 378us) client_negotiation.cc:769] Sending connection context
0811 07:02:43.383125 (+ 274us) client_negotiation.cc:240] Negotiation successful
0811 07:02:43.383696 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":422,"threads_started":1}
I20260811 07:02:43.386943 3412 heartbeater.cc:347] Connected to a master server at 127.30.73.126:34901
I20260811 07:02:43.387356 3412 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:43.388092 3412 heartbeater.cc:511] Master 127.30.73.126:34901 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
I20260811 07:02:43.390378 3200 ts_manager.cc:194] Registered new tserver with Master: 618927c3719642bcbf247ca126716bdc (127.30.73.65:33717)
I20260811 07:02:43.391925 3200 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:45723
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:02:43.421753 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:34901
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:43.782263 3419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:43.782548 3419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:43.782657 3419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:43.790138 3419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:43.790270 3419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:43.790393 3419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:43.800804 3419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:34901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:43.802203 3419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:43.803565 3419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:43.817301 3427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:43.817240 3429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:43.817359 3426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:43.818054 3419 server_base.cc:1034] running on GCE node
I20260811 07:02:43.818742 3419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:43.819778 3419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:43.821028 3419 hybrid_clock.cc:648] HybridClock initialized: now 1786431763820973 us; error 78 us; skew 500 ppm
I20260811 07:02:43.821378 3419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:43 dist-test-slave-69rg krb5kdc[3148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431763, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:43.824944 3419 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:02:43.826278 3419 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:43.826419 3419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:43.826767 3419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:43.830112 3419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "d81251ba631a49a2a3575447a4017d6a"
format_stamp: "Formatted at 2026-08-11 07:02:43 on dist-test-slave-69rg"
server_key: "3a01036c2590c16362c3c44ef7c62a6d"
server_key_iv: "a6cd804080ed1dab6486dac3b25e2116"
server_key_version: "encryptionkey@0"
I20260811 07:02:43.830989 3419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "d81251ba631a49a2a3575447a4017d6a"
format_stamp: "Formatted at 2026-08-11 07:02:43 on dist-test-slave-69rg"
server_key: "3a01036c2590c16362c3c44ef7c62a6d"
server_key_iv: "a6cd804080ed1dab6486dac3b25e2116"
server_key_version: "encryptionkey@0"
I20260811 07:02:43.836540 3419 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:43.840426 3437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:43.841805 3419 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 07:02:43.842053 3419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "d81251ba631a49a2a3575447a4017d6a"
format_stamp: "Formatted at 2026-08-11 07:02:43 on dist-test-slave-69rg"
server_key: "3a01036c2590c16362c3c44ef7c62a6d"
server_key_iv: "a6cd804080ed1dab6486dac3b25e2116"
server_key_version: "encryptionkey@0"
I20260811 07:02:43.842320 3419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:43.867300 3419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:43.872304 3419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:43.872740 3419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:43.874079 3419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:43.875742 3419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:43.875901 3419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:43.876030 3419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:43.876120 3419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:43.913638 3419 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:45377
I20260811 07:02:43.913736 3568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:45377 every 8 connection(s)
I20260811 07:02:43.914633 3419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:43.917075 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 3419
I20260811 07:02:43.917286 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:43.917904 31013 external_mini_cluster.cc:1428] Setting key 102b29460fbaeb4948e9ee64ddec0047
Aug 11 07:02:43 dist-test-slave-69rg krb5kdc[3148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431763, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:43.938056 3571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:43.917281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:52169 (local address 127.30.73.126:34901)
0811 07:02:43.917757 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:43.917762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:43.919122 (+ 1360us) server_negotiation.cc:407] Connection header received
0811 07:02:43.921203 (+ 2081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:43.921209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:43.921303 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:43.921424 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:43.923147 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:43.923849 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:43.925449 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:43.925958 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:43.926116 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:43.931049 (+ 4933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:43.931055 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:43.931059 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:43.931098 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:43.933956 (+ 2858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:43.935120 (+ 1164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:43.935124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:43.935126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:43.935298 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:43.935911 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:43.935914 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:43.935917 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:43.936233 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:43.936354 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:43.937502 (+ 1148us) server_negotiation.cc:299] Negotiation successful
0811 07:02:43.937707 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":273,"threads_started":1}
I20260811 07:02:43.939993 3573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:43.917991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34901 (local address 127.30.73.66:52169)
0811 07:02:43.918937 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:43.918976 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:43.920885 (+ 1909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:43.921671 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:43.921679 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:43.922320 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:43.922944 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:43.922962 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:43.924015 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:43.924025 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:43.925287 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:43.925300 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:43.926193 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:43.926200 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:43.926595 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:43.927435 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:43.927472 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:43.930726 (+ 3254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:43.934136 (+ 3410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:43.934151 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:43.934176 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:43.934918 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:43.935440 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:43.935447 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:43.935453 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:43.935760 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:43.936382 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:43.936394 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:43.936926 (+ 532us) client_negotiation.cc:769] Sending connection context
0811 07:02:43.937305 (+ 379us) client_negotiation.cc:240] Negotiation successful
0811 07:02:43.937990 (+ 685us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":365,"threads_started":1}
I20260811 07:02:43.941946 3569 heartbeater.cc:347] Connected to a master server at 127.30.73.126:34901
I20260811 07:02:43.942354 3569 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
I20260811 07:02:43.943167 3569 heartbeater.cc:511] Master 127.30.73.126:34901 requested a full tablet report, sending...
I20260811 07:02:43.944914 3200 ts_manager.cc:194] Registered new tserver with Master: d81251ba631a49a2a3575447a4017d6a (127.30.73.66:45377)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
I20260811 07:02:43.946029 3200 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:52169
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:02:43.978727 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:34901
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:44.338104 3576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:44.338466 3576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:44.338656 3576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:44.346930 3576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:44.347098 3576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:44.347287 3576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:44.357322 3576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:34901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:44.358876 3576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:44.360204 3576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:44.374099 3582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:44.374065 3586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:44.374166 3583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:44.375018 3576 server_base.cc:1034] running on GCE node
I20260811 07:02:44.375582 3576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:44.376488 3576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:44.377760 3576 hybrid_clock.cc:648] HybridClock initialized: now 1786431764377699 us; error 50 us; skew 500 ppm
I20260811 07:02:44.378197 3576 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:44 dist-test-slave-69rg krb5kdc[3148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431764, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:44.381548 3576 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:02:44.382827 3576 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:44.382966 3576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:44.383307 3576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:44.386293 3576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "db5153af0d9f49cf91455f022dd384f7"
format_stamp: "Formatted at 2026-08-11 07:02:44 on dist-test-slave-69rg"
server_key: "25c8d80a4c04b2f48d358dbfd943e7f4"
server_key_iv: "7c884612da6324c338273e473b8a8ca2"
server_key_version: "encryptionkey@0"
I20260811 07:02:44.387187 3576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "db5153af0d9f49cf91455f022dd384f7"
format_stamp: "Formatted at 2026-08-11 07:02:44 on dist-test-slave-69rg"
server_key: "25c8d80a4c04b2f48d358dbfd943e7f4"
server_key_iv: "7c884612da6324c338273e473b8a8ca2"
server_key_version: "encryptionkey@0"
I20260811 07:02:44.392453 3576 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:02:44.395146 3412 heartbeater.cc:503] Master 127.30.73.126:34901 was elected leader, sending a full tablet report...
I20260811 07:02:44.396543 3594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:44.398182 3576 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:02:44.398391 3576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "db5153af0d9f49cf91455f022dd384f7"
format_stamp: "Formatted at 2026-08-11 07:02:44 on dist-test-slave-69rg"
server_key: "25c8d80a4c04b2f48d358dbfd943e7f4"
server_key_iv: "7c884612da6324c338273e473b8a8ca2"
server_key_version: "encryptionkey@0"
I20260811 07:02:44.398653 3576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:44.411962 3576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:44.415987 3576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:44.416276 3576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:44.417200 3576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:44.418663 3576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:44.418797 3576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:44.418942 3576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:44.419035 3576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:44.455585 3576 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:43427
I20260811 07:02:44.455674 3720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:43427 every 8 connection(s)
I20260811 07:02:44.456499 3576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:44.465493 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 3576
I20260811 07:02:44.465884 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:44.466408 31013 external_mini_cluster.cc:1428] Setting key 0fe2f220662e98dea71fa795f369cdde
Aug 11 07:02:44 dist-test-slave-69rg krb5kdc[3148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431764, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:44.478227 3725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.459169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:58123 (local address 127.30.73.126:34901)
0811 07:02:44.459707 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:44.459715 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:44.461605 (+ 1890us) server_negotiation.cc:407] Connection header received
0811 07:02:44.463538 (+ 1933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:44.463544 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:44.463649 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:44.463775 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:44.465323 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.466271 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.467908 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.468351 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.468501 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.472148 (+ 3647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:44.472154 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:44.472157 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:44.472190 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:44.474843 (+ 2653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:44.475576 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:44.475583 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:44.475587 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:44.475711 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:44.476144 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:44.476151 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:44.476155 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:44.476428 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:44.476595 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:44.477518 (+ 923us) server_negotiation.cc:299] Negotiation successful
0811 07:02:44.477791 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":243,"threads_started":1}
I20260811 07:02:44.479215 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.459797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:34901 (local address 127.30.73.67:58123)
0811 07:02:44.461436 (+ 1639us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:44.461477 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:44.463255 (+ 1778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:44.464033 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:44.464041 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:44.464555 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:44.465129 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.465146 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.466430 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.466435 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.467760 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.467772 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.468588 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.468596 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.468842 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.469549 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:44.469573 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:44.471902 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:44.474997 (+ 3095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:44.475006 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:44.475023 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:44.475449 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:44.475826 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:44.475831 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:44.475835 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:44.476022 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:44.476566 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:44.476574 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:44.477043 (+ 469us) client_negotiation.cc:769] Sending connection context
0811 07:02:44.477415 (+ 372us) client_negotiation.cc:240] Negotiation successful
0811 07:02:44.478004 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1353,"thread_start_us":1121,"threads_started":1}
I20260811 07:02:44.480841 3722 heartbeater.cc:347] Connected to a master server at 127.30.73.126:34901
I20260811 07:02:44.481220 3722 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:44.482088 3722 heartbeater.cc:511] Master 127.30.73.126:34901 requested a full tablet report, sending...
I20260811 07:02:44.483565 3200 ts_manager.cc:194] Registered new tserver with Master: db5153af0d9f49cf91455f022dd384f7 (127.30.73.67:43427)
I20260811 07:02:44.484360 3200 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:58123
I20260811 07:02:44.494546 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:02:44.512048 3725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.499390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49326 (local address 127.30.73.126:34901)
0811 07:02:44.499679 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:44.499686 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:44.499994 (+ 308us) server_negotiation.cc:407] Connection header received
0811 07:02:44.500136 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:44.500140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:44.500203 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:44.500286 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:44.501750 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.502608 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.504030 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.504505 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.504597 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.506847 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:44.506852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:44.506856 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:44.506887 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:44.509493 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:44.510239 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:44.510243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:44.510245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:44.510360 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:44.510684 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:44.510687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:44.510689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:44.511002 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:44.511198 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:44.511538 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 07:02:44.511702 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:02:44.516079 3200 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49326:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:02:44.522938 3200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:44.565619 3747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.536662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56306 (local address 127.30.73.66:45377)
0811 07:02:44.557644 (+ 20982us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:44.557652 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:44.557680 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:02:44.557775 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:44.557785 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:44.558016 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:44.558229 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:44.558976 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.560423 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.562914 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.564320 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.564477 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.564691 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:44.565074 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 07:02:44.565265 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20789,"thread_start_us":20678,"threads_started":1}
I20260811 07:02:44.565702 3748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.536349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:45377 (local address 127.0.0.1:56306)
0811 07:02:44.556047 (+ 19698us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:44.556071 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:44.556234 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:44.558227 (+ 1993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:44.558231 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:44.558255 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:44.558764 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.558776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.560566 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.560571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.562748 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.562761 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.564546 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.564555 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.564771 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.564847 (+ 76us) client_negotiation.cc:769] Sending connection context
0811 07:02:44.565005 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 07:02:44.565219 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19547,"mutex_wait_us":105,"thread_start_us":20609,"threads_started":1}
I20260811 07:02:44.566004 3745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.536186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:33717 (local address 127.0.0.1:47816)
0811 07:02:44.552207 (+ 16021us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:44.552278 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:44.552520 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:44.557685 (+ 5165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:44.557693 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:44.557730 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:44.558242 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.558261 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.560291 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.560296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.563116 (+ 2820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.563132 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.564945 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.564952 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.565210 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.565270 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 07:02:44.565345 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 07:02:44.565477 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15659,"mutex_wait_us":83,"thread_start_us":15475,"threads_started":1}
I20260811 07:02:44.566490 3749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.536830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47816 (local address 127.30.73.65:33717)
0811 07:02:44.556959 (+ 20129us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:44.556971 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:44.557005 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:02:44.557124 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:44.557132 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:44.557430 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:44.557647 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:44.558488 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.560136 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.563295 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.564710 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.565282 (+ 572us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.565515 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:44.565621 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 07:02:44.565789 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19894,"thread_start_us":19690,"threads_started":1}
I20260811 07:02:44.566908 3746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.536757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:43427 (local address 127.0.0.1:43716)
0811 07:02:44.557342 (+ 20585us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:44.557365 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:44.557601 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:44.558559 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:44.558568 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:44.558609 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:44.559003 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.559012 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.561108 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.561114 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.563372 (+ 2258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.563382 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.564868 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.564882 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.565167 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.566311 (+ 1144us) client_negotiation.cc:769] Sending connection context
0811 07:02:44.566407 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:02:44.566550 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20426,"mutex_wait_us":95,"thread_start_us":19001,"threads_started":1}
I20260811 07:02:44.567361 3751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.537440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43716 (local address 127.30.73.67:43427)
0811 07:02:44.555554 (+ 18114us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:44.555567 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:44.557471 (+ 1904us) server_negotiation.cc:407] Connection header received
0811 07:02:44.557810 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:44.557839 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:44.558119 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:44.558303 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:44.559211 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.560905 (+ 1694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.563520 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.564498 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.564627 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.564851 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:44.566481 (+ 1630us) server_negotiation.cc:299] Negotiation successful
0811 07:02:44.566817 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17908,"thread_start_us":17733,"threads_started":1}
I20260811 07:02:44.569867 3496 tablet_service.cc:1467] Processing CreateTablet for tablet 94dbc47f4aa34cf5aa4e3c91acbcc339 (DEFAULT_TABLE table=test-table [id=dd9ec08ae0bb45d49c93a9ad7565d98b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:44.571208 3496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94dbc47f4aa34cf5aa4e3c91acbcc339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:44.573264 3652 tablet_service.cc:1467] Processing CreateTablet for tablet 94dbc47f4aa34cf5aa4e3c91acbcc339 (DEFAULT_TABLE table=test-table [id=dd9ec08ae0bb45d49c93a9ad7565d98b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:44.573264 3344 tablet_service.cc:1467] Processing CreateTablet for tablet 94dbc47f4aa34cf5aa4e3c91acbcc339 (DEFAULT_TABLE table=test-table [id=dd9ec08ae0bb45d49c93a9ad7565d98b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:44.574680 3652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94dbc47f4aa34cf5aa4e3c91acbcc339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:44.574668 3344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94dbc47f4aa34cf5aa4e3c91acbcc339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:44.582522 3752 tablet_bootstrap.cc:492] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: Bootstrap starting.
I20260811 07:02:44.585695 3752 tablet_bootstrap.cc:654] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:44.586897 3752 log.cc:824] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:44.589716 3757 tablet_bootstrap.cc:492] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: Bootstrap starting.
I20260811 07:02:44.590715 3756 tablet_bootstrap.cc:492] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: Bootstrap starting.
I20260811 07:02:44.590976 3752 tablet_bootstrap.cc:492] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: No bootstrap required, opened a new log
I20260811 07:02:44.591291 3752 ts_tablet_manager.cc:1397] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260811 07:02:44.593556 3756 tablet_bootstrap.cc:654] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:44.593621 3757 tablet_bootstrap.cc:654] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:44.594643 3756 log.cc:824] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:44.594822 3757 log.cc:824] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:44.597870 3757 tablet_bootstrap.cc:492] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: No bootstrap required, opened a new log
I20260811 07:02:44.597885 3756 tablet_bootstrap.cc:492] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: No bootstrap required, opened a new log
I20260811 07:02:44.598169 3757 ts_tablet_manager.cc:1397] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 07:02:44.598179 3756 ts_tablet_manager.cc:1397] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 07:02:44.602078 3752 raft_consensus.cc:348] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } }
I20260811 07:02:44.602620 3752 raft_consensus.cc:374] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:44.602787 3752 raft_consensus.cc:729] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d81251ba631a49a2a3575447a4017d6a, State: Initialized, Role: FOLLOWER
I20260811 07:02:44.603446 3752 consensus_queue.cc:260] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } }
I20260811 07:02:44.604811 3569 heartbeater.cc:503] Master 127.30.73.126:34901 was elected leader, sending a full tablet report...
I20260811 07:02:44.605398 3752 ts_tablet_manager.cc:1428] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260811 07:02:44.607466 3757 raft_consensus.cc:348] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } }
I20260811 07:02:44.607833 3757 raft_consensus.cc:374] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:44.607960 3757 raft_consensus.cc:729] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db5153af0d9f49cf91455f022dd384f7, State: Initialized, Role: FOLLOWER
I20260811 07:02:44.608578 3757 consensus_queue.cc:260] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } }
I20260811 07:02:44.608493 3756 raft_consensus.cc:348] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } }
I20260811 07:02:44.608927 3756 raft_consensus.cc:374] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:44.609066 3756 raft_consensus.cc:729] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618927c3719642bcbf247ca126716bdc, State: Initialized, Role: FOLLOWER
I20260811 07:02:44.609651 3756 consensus_queue.cc:260] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } }
I20260811 07:02:44.609862 3722 heartbeater.cc:503] Master 127.30.73.126:34901 was elected leader, sending a full tablet report...
I20260811 07:02:44.610646 3757 ts_tablet_manager.cc:1428] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260811 07:02:44.612902 3756 ts_tablet_manager.cc:1428] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260811 07:02:44.615091 3413 tablet.cc:2369] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:02:44.666978 3570 tablet.cc:2369] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:02:44.708058 3723 tablet.cc:2369] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:02:44.835418 3762 raft_consensus.cc:482] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:44.835729 3762 raft_consensus.cc:504] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } }
I20260811 07:02:44.837435 3762 leader_election.cc:288] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618927c3719642bcbf247ca126716bdc (127.30.73.65:33717), d81251ba631a49a2a3575447a4017d6a (127.30.73.66:45377)
I20260811 07:02:44.843983 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.837846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:45377 (local address 127.30.73.67:53353)
0811 07:02:44.838158 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:44.838182 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:44.838313 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:44.838739 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:44.838744 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:44.838779 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:44.838992 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.839002 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.840307 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.840311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.842080 (+ 1769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.842107 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.843452 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.843456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.843585 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.843613 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:02:44.843686 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:02:44.843779 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 07:02:44.844143 3747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.838079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:53353 (local address 127.30.73.66:45377)
0811 07:02:44.838245 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:44.838250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:44.838269 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:02:44.838494 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:44.838498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:44.838563 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:44.838715 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:44.839154 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.840172 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.842276 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.843301 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.843469 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.843546 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:44.843752 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 07:02:44.843885 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 07:02:44.845173 3749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.838001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:40309 (local address 127.30.73.65:33717)
0811 07:02:44.838244 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:44.838251 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:44.839272 (+ 1021us) server_negotiation.cc:407] Connection header received
0811 07:02:44.839430 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:44.839437 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:44.839521 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:44.839630 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:02:44.840166 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.840927 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.843056 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.844287 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.844456 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.844526 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:44.844805 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 07:02:44.844933 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 07:02:44.845345 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.837847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:33717 (local address 127.30.73.67:40309)
0811 07:02:44.839151 (+ 1304us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:44.839170 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:44.839301 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:44.839674 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:44.839678 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:44.839698 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:02:44.839974 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.839981 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.841087 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.841093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.842805 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:44.842816 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.844513 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.844520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:44.844643 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.844664 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:02:44.844772 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:02:44.844892 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1168,"mutex_wait_us":548,"thread_start_us":611,"threads_started":1}
I20260811 07:02:44.845115 3517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94dbc47f4aa34cf5aa4e3c91acbcc339" candidate_uuid: "db5153af0d9f49cf91455f022dd384f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d81251ba631a49a2a3575447a4017d6a" is_pre_election: true
I20260811 07:02:44.845715 3517 raft_consensus.cc:2454] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db5153af0d9f49cf91455f022dd384f7 in term 0.
I20260811 07:02:44.846522 3595 leader_election.cc:302] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d81251ba631a49a2a3575447a4017d6a, db5153af0d9f49cf91455f022dd384f7; no voters:
I20260811 07:02:44.846426 3366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94dbc47f4aa34cf5aa4e3c91acbcc339" candidate_uuid: "db5153af0d9f49cf91455f022dd384f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618927c3719642bcbf247ca126716bdc" is_pre_election: true
I20260811 07:02:44.846957 3366 raft_consensus.cc:2454] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db5153af0d9f49cf91455f022dd384f7 in term 0.
I20260811 07:02:44.846995 3762 raft_consensus.cc:2781] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:44.847143 3762 raft_consensus.cc:482] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:44.847304 3762 raft_consensus.cc:3037] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:44.849713 3762 raft_consensus.cc:504] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } }
I20260811 07:02:44.850528 3762 leader_election.cc:288] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [CANDIDATE]: Term 1 election: Requested vote from peers 618927c3719642bcbf247ca126716bdc (127.30.73.65:33717), d81251ba631a49a2a3575447a4017d6a (127.30.73.66:45377)
I20260811 07:02:44.850925 3366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94dbc47f4aa34cf5aa4e3c91acbcc339" candidate_uuid: "db5153af0d9f49cf91455f022dd384f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618927c3719642bcbf247ca126716bdc"
I20260811 07:02:44.851073 3517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94dbc47f4aa34cf5aa4e3c91acbcc339" candidate_uuid: "db5153af0d9f49cf91455f022dd384f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d81251ba631a49a2a3575447a4017d6a"
I20260811 07:02:44.851151 3366 raft_consensus.cc:3037] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:44.851353 3517 raft_consensus.cc:3037] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:44.853464 3366 raft_consensus.cc:2454] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db5153af0d9f49cf91455f022dd384f7 in term 1.
I20260811 07:02:44.853667 3517 raft_consensus.cc:2454] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db5153af0d9f49cf91455f022dd384f7 in term 1.
I20260811 07:02:44.853966 3597 leader_election.cc:302] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618927c3719642bcbf247ca126716bdc, db5153af0d9f49cf91455f022dd384f7; no voters:
I20260811 07:02:44.854283 3762 raft_consensus.cc:2781] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:44.854789 3762 raft_consensus.cc:686] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 1 LEADER]: Becoming Leader. State: Replica: db5153af0d9f49cf91455f022dd384f7, State: Running, Role: LEADER
I20260811 07:02:44.855285 3762 consensus_queue.cc:237] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } }
I20260811 07:02:44.859959 3199 catalog_manager.cc:5495] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to db5153af0d9f49cf91455f022dd384f7 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "db5153af0d9f49cf91455f022dd384f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db5153af0d9f49cf91455f022dd384f7" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260811 07:02:44.917260 3751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.911821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43718 (local address 127.30.73.67:43427)
0811 07:02:44.912029 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:44.912036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:44.912057 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:02:44.912187 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:44.912191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:44.912301 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:44.912466 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:02:44.912849 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.913666 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.915073 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.915498 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.915640 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.916137 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:02:44.916612 (+ 475us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:02:44.916772 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:44.916898 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 07:02:44.916984 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:02:44.927007 3517 raft_consensus.cc:1261] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [term 1 FOLLOWER]: Refusing update from remote peer db5153af0d9f49cf91455f022dd384f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:44.927130 3366 raft_consensus.cc:1261] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [term 1 FOLLOWER]: Refusing update from remote peer db5153af0d9f49cf91455f022dd384f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:44.928118 3765 consensus_queue.cc:1035] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d81251ba631a49a2a3575447a4017d6a" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 45377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:44.928495 3762 consensus_queue.cc:1035] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618927c3719642bcbf247ca126716bdc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 33717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:44.942777 3772 mvcc.cc:205] Tried to move back new op lower bound from 7317224509130661888 to 7317224508851179520. Current Snapshot: MvccSnapshot[applied={T|T < 7317224509130661888}]
I20260811 07:02:44.946841 3773 mvcc.cc:205] Tried to move back new op lower bound from 7317224509130661888 to 7317224508851179520. Current Snapshot: MvccSnapshot[applied={T|T < 7317224509130661888}]
I20260811 07:02:44.955485 3199 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49326:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:44.955796 3199 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49326:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:44.960007 3199 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f70f9f5bfcc34a6ea11d804f614a57c8: Sending DeleteTablet for 3 replicas of tablet 94dbc47f4aa34cf5aa4e3c91acbcc339
I20260811 07:02:44.961323 3344 tablet_service.cc:1514] Processing DeleteTablet for tablet 94dbc47f4aa34cf5aa4e3c91acbcc339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:44 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:47816
I20260811 07:02:44.961318 3496 tablet_service.cc:1514] Processing DeleteTablet for tablet 94dbc47f4aa34cf5aa4e3c91acbcc339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:44 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:56306
I20260811 07:02:44.961651 3652 tablet_service.cc:1514] Processing DeleteTablet for tablet 94dbc47f4aa34cf5aa4e3c91acbcc339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:44 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:43716
I20260811 07:02:44.963801 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 3271
I20260811 07:02:44.966318 3784 tablet_replica.cc:330] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: stopping tablet replica
I20260811 07:02:44.966836 3784 raft_consensus.cc:2229] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:02:44.967538 3784 raft_consensus.cc:2258] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:44.976979 3782 tablet_replica.cc:330] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: stopping tablet replica
I20260811 07:02:44.977494 3782 raft_consensus.cc:2229] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:44.978094 3782 raft_consensus.cc:2258] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:44.978935 3783 tablet_replica.cc:330] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: stopping tablet replica
I20260811 07:02:44.979368 3783 raft_consensus.cc:2229] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:44.979671 3784 ts_tablet_manager.cc:1905] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:44.979853 3783 raft_consensus.cc:2258] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:44.981894 3783 ts_tablet_manager.cc:1905] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 07:02:44 dist-test-slave-69rg krb5kdc[3148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:44.988451 3782 ts_tablet_manager.cc:1905] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:44.989203 3784 ts_tablet_manager.cc:1918] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:02:44.989660 3784 log.cc:1196] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/94dbc47f4aa34cf5aa4e3c91acbcc339
I20260811 07:02:44.990301 3784 ts_tablet_manager.cc:1939] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P db5153af0d9f49cf91455f022dd384f7: Deleting consensus metadata
I20260811 07:02:44.992249 3183 catalog_manager.cc:4841] TS db5153af0d9f49cf91455f022dd384f7 (127.30.73.67:43427): tablet 94dbc47f4aa34cf5aa4e3c91acbcc339 (table test-table [id=dd9ec08ae0bb45d49c93a9ad7565d98b]) successfully deleted
I20260811 07:02:44.995044 3783 ts_tablet_manager.cc:1918] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:02:44.995225 3783 log.cc:1196] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/94dbc47f4aa34cf5aa4e3c91acbcc339
I20260811 07:02:44.995786 3783 ts_tablet_manager.cc:1939] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P d81251ba631a49a2a3575447a4017d6a: Deleting consensus metadata
I20260811 07:02:44.996129 3782 ts_tablet_manager.cc:1918] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:02:44.996213 3749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:44.965195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47828 (local address 127.30.73.65:33717)
0811 07:02:44.965444 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:44.965453 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:44.976054 (+ 10601us) server_negotiation.cc:407] Connection header received
0811 07:02:44.976281 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:44.976290 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:44.976441 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:44.976599 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:44.978291 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.979197 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.980755 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:44.981394 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:44.981523 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:44.987362 (+ 5839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:44.987377 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:44.987395 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:44.987446 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:44.991885 (+ 4439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:44.993010 (+ 1125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:44.993033 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:44.993037 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:44.993304 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:44.993834 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:44.993840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:44.993843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:44.994370 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:44.994704 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:44.995467 (+ 763us) server_negotiation.cc:299] Negotiation successful
0811 07:02:44.995704 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:02:44.996335 3782 log.cc:1196] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/94dbc47f4aa34cf5aa4e3c91acbcc339
I20260811 07:02:44.997175 3782 ts_tablet_manager.cc:1939] T 94dbc47f4aa34cf5aa4e3c91acbcc339 P 618927c3719642bcbf247ca126716bdc: Deleting consensus metadata
I20260811 07:02:44.997763 3182 catalog_manager.cc:4841] TS d81251ba631a49a2a3575447a4017d6a (127.30.73.66:45377): tablet 94dbc47f4aa34cf5aa4e3c91acbcc339 (table test-table [id=dd9ec08ae0bb45d49c93a9ad7565d98b]) successfully deleted
I20260811 07:02:44.998025 3407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:45.113360 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 3271
I20260811 07:02:45.113488 3184 catalog_manager.cc:4841] TS 618927c3719642bcbf247ca126716bdc (127.30.73.65:33717): tablet 94dbc47f4aa34cf5aa4e3c91acbcc339 (table test-table [id=dd9ec08ae0bb45d49c93a9ad7565d98b]) successfully deleted
I20260811 07:02:45.135255 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 3419
Aug 11 07:02:45 dist-test-slave-69rg krb5kdc[3148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:02:45.155309 3747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:45.136106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56310 (local address 127.30.73.66:45377)
0811 07:02:45.136307 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:45.136313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:45.136335 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:02:45.136474 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:45.136481 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:45.136568 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:45.136690 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:45.137981 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:45.139095 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:45.140767 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:45.141437 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:45.141599 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:45.146715 (+ 5116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:45.146741 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:45.146766 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:45.146826 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:45.150856 (+ 4030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:45.152042 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:45.152059 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:45.152063 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:45.152376 (+ 313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:45.152990 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:45.153002 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:45.153005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:45.153653 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:45.154039 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:45.154658 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 07:02:45.154911 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:02:45.156092 3562 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:45.248890 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 3419
I20260811 07:02:45.270957 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 3576
Aug 11 07:02:45 dist-test-slave-69rg krb5kdc[3148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:02:45.287853 3751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:45.271787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43728 (local address 127.30.73.67:43427)
0811 07:02:45.272017 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:45.272023 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:45.272044 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:02:45.272181 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:45.272187 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:45.272286 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:45.272416 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:45.273700 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:45.274764 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:45.275963 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:45.276454 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:45.276605 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:45.281288 (+ 4683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:45.281301 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:45.281317 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:45.281356 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:45.284506 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:45.285196 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:45.285213 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:45.285215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:45.285376 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:45.286009 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:45.286015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:45.286018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:45.286428 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:45.286800 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:45.287056 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 07:02:45.287298 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 07:02:45.288700 3716 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:45.416139 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 3576
I20260811 07:02:45.442592 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 3164
I20260811 07:02:45.443892 3238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:45.554126 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 3164
2026-08-11T07:02:45Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4749 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T07:02:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:45Z Disabled control of system clock
I20260811 07:02:45.635784 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36357
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:41217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:36357
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:02:45.995333 3794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:45.995956 3794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:45.996069 3794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:46.005541 3794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:46.005708 3794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:46.005752 3794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:46.005810 3794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:46.005949 3794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:46.019757 3794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:41217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:36357
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:46.021772 3794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:46.025106 3794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:46.043155 3803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:46.043093 3800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:46.043115 3801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:46.044706 3794 server_base.cc:1034] running on GCE node
I20260811 07:02:46.047214 3794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:46.049681 3794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:46.051266 3794 hybrid_clock.cc:648] HybridClock initialized: now 1786431766051207 us; error 55 us; skew 500 ppm
I20260811 07:02:46.051767 3794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:02:46.063761 3794 webserver.cc:460] Webserver started at http://127.30.73.126:34593/ using document root <none> and password file <none>
I20260811 07:02:46.064968 3794 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:46.065126 3794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:46.065536 3794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:46.070058 3794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "c8e390c91feb4826b38a4bf4d4ceb086"
format_stamp: "Formatted at 2026-08-11 07:02:46 on dist-test-slave-69rg"
server_key: "ad5c77a2594796ebf2fca17d3a216ae4"
server_key_iv: "b0f8bb0dde1b70b501562fd70726761f"
server_key_version: "encryptionkey@0"
I20260811 07:02:46.071435 3794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "c8e390c91feb4826b38a4bf4d4ceb086"
format_stamp: "Formatted at 2026-08-11 07:02:46 on dist-test-slave-69rg"
server_key: "ad5c77a2594796ebf2fca17d3a216ae4"
server_key_iv: "b0f8bb0dde1b70b501562fd70726761f"
server_key_version: "encryptionkey@0"
I20260811 07:02:46.078902 3794 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260811 07:02:46.084784 3810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:46.086565 3794 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:02:46.086813 3794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "c8e390c91feb4826b38a4bf4d4ceb086"
format_stamp: "Formatted at 2026-08-11 07:02:46 on dist-test-slave-69rg"
server_key: "ad5c77a2594796ebf2fca17d3a216ae4"
server_key_iv: "b0f8bb0dde1b70b501562fd70726761f"
server_key_version: "encryptionkey@0"
I20260811 07:02:46.087262 3794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:46.095136 3794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:46.096767 3794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:46.097348 3794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:46.125711 3794 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:36357
I20260811 07:02:46.125970 3869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:36357 every 8 connection(s)
I20260811 07:02:46.127279 3794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:46.131691 3870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:46.132833 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 3794
I20260811 07:02:46.133057 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:46.133984 31013 external_mini_cluster.cc:1428] Setting key 87765d88736dbcc1d8d68b57100b40ce
I20260811 07:02:46.143715 3873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:46.136377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46896 (local address 127.30.73.126:36357)
0811 07:02:46.137489 (+ 1112us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:46.137501 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:46.137546 (+ 45us) server_negotiation.cc:407] Connection header received
0811 07:02:46.139227 (+ 1681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:46.139251 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:46.139953 (+ 702us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:46.140749 (+ 796us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:46.141991 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:46.141997 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:46.142012 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:46.142026 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:46.142083 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:46.142100 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:46.142356 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:46.142507 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 07:02:46.142779 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":420,"threads_started":1}
I20260811 07:02:46.147410 3870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086: Bootstrap starting.
I20260811 07:02:46.151290 3870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:46.152513 3870 log.cc:824] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:46.156145 3870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086: No bootstrap required, opened a new log
I20260811 07:02:46.165756 3870 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e390c91feb4826b38a4bf4d4ceb086" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36357 } }
I20260811 07:02:46.166316 3870 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:46.166662 3870 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e390c91feb4826b38a4bf4d4ceb086, State: Initialized, Role: FOLLOWER
I20260811 07:02:46.167346 3870 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e390c91feb4826b38a4bf4d4ceb086" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36357 } }
I20260811 07:02:46.167562 3870 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:46.167742 3870 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:46.167960 3870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:46.170677 3870 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e390c91feb4826b38a4bf4d4ceb086" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36357 } }
I20260811 07:02:46.171311 3870 leader_election.cc:302] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8e390c91feb4826b38a4bf4d4ceb086; no voters:
I20260811 07:02:46.172008 3870 leader_election.cc:288] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:46.172317 3875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:46.173199 3875 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [term 1 LEADER]: Becoming Leader. State: Replica: c8e390c91feb4826b38a4bf4d4ceb086, State: Running, Role: LEADER
I20260811 07:02:46.173802 3875 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e390c91feb4826b38a4bf4d4ceb086" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36357 } }
I20260811 07:02:46.174808 3870 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:46.177165 3877 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8e390c91feb4826b38a4bf4d4ceb086. Latest consensus state: current_term: 1 leader_uuid: "c8e390c91feb4826b38a4bf4d4ceb086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e390c91feb4826b38a4bf4d4ceb086" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36357 } } }
I20260811 07:02:46.177645 3877 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:46.177459 3876 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8e390c91feb4826b38a4bf4d4ceb086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e390c91feb4826b38a4bf4d4ceb086" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36357 } } }
I20260811 07:02:46.177770 3876 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:46.180378 3883 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:46.185787 3883 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:46.197358 3883 catalog_manager.cc:1347] Generated new cluster ID: 9b956af8180a49e3838e6724eb66a58b
I20260811 07:02:46.197521 3883 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:46.215085 3883 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:46.215528 3883 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:46.231029 3883 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086: Generated new TSK 0
I20260811 07:02:46.232141 3883 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:02:46.237555 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36357
--builtin_ntp_servers=127.30.73.84:41217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:02:46.603981 3896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:46.604373 3896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:46.604554 3896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:46.611877 3896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:46.611996 3896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:46.612193 3896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:46.621776 3896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:41217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:46.623301 3896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:46.625193 3896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:46.638968 3901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:46.638938 3902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:46.639263 3908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:46.639902 3896 server_base.cc:1034] running on GCE node
I20260811 07:02:46.640564 3896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:46.641587 3896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:46.642825 3896 hybrid_clock.cc:648] HybridClock initialized: now 1786431766642771 us; error 67 us; skew 500 ppm
I20260811 07:02:46.643174 3896 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:02:46.651319 3896 webserver.cc:460] Webserver started at http://127.30.73.65:40917/ using document root <none> and password file <none>
I20260811 07:02:46.652109 3896 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:46.652287 3896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:46.652645 3896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:46.655674 3896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "9ffae33977a94765ac2cf0b0b41ee44e"
format_stamp: "Formatted at 2026-08-11 07:02:46 on dist-test-slave-69rg"
server_key: "79b3a24bfd657d314b2399a92d2876a6"
server_key_iv: "e44a730615d7f6e194ecb48c3b10a1d0"
server_key_version: "encryptionkey@0"
I20260811 07:02:46.656508 3896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "9ffae33977a94765ac2cf0b0b41ee44e"
format_stamp: "Formatted at 2026-08-11 07:02:46 on dist-test-slave-69rg"
server_key: "79b3a24bfd657d314b2399a92d2876a6"
server_key_iv: "e44a730615d7f6e194ecb48c3b10a1d0"
server_key_version: "encryptionkey@0"
I20260811 07:02:46.661796 3896 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 07:02:46.665390 3914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:46.666724 3896 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 07:02:46.666918 3896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "9ffae33977a94765ac2cf0b0b41ee44e"
format_stamp: "Formatted at 2026-08-11 07:02:46 on dist-test-slave-69rg"
server_key: "79b3a24bfd657d314b2399a92d2876a6"
server_key_iv: "e44a730615d7f6e194ecb48c3b10a1d0"
server_key_version: "encryptionkey@0"
I20260811 07:02:46.667155 3896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:46.672842 3896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:46.673633 3896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:46.673974 3896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:46.674963 3896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:46.676596 3896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:46.676720 3896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:46.676863 3896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:46.676954 3896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:46.717680 3896 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:37909
I20260811 07:02:46.717708 4044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:37909 every 8 connection(s)
I20260811 07:02:46.719650 3896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:46.726416 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 3896
I20260811 07:02:46.726615 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:46.727473 31013 external_mini_cluster.cc:1428] Setting key 53998861d74f571b6109b38307025c8c
I20260811 07:02:46.732100 4047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:46.722631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:46683 (local address 127.30.73.126:36357)
0811 07:02:46.723186 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:46.723196 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:46.724845 (+ 1649us) server_negotiation.cc:407] Connection header received
0811 07:02:46.728186 (+ 3341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:46.728195 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:46.728282 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:46.728379 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:46.731095 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:46.731103 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:46.731110 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:46.731135 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:46.731197 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:46.731218 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:46.731341 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:46.731714 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 07:02:46.731780 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":253,"threads_started":1}
I20260811 07:02:46.733862 4048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:46.723263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36357 (local address 127.30.73.65:46683)
0811 07:02:46.724667 (+ 1404us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:46.724717 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:46.727795 (+ 3078us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:46.728991 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:46.729005 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:46.729149 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:46.730364 (+ 1215us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:02:46.730370 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:46.730434 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:02:46.730862 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:46.731452 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:46.731464 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:46.731474 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:02:46.731814 (+ 340us) client_negotiation.cc:240] Negotiation successful
0811 07:02:46.732102 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":437,"threads_started":1}
I20260811 07:02:46.734899 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36357
--builtin_ntp_servers=127.30.73.84:41217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 07:02:46.735451 4045 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36357
I20260811 07:02:46.735816 4045 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:46.736649 4045 heartbeater.cc:511] Master 127.30.73.126:36357 requested a full tablet report, sending...
I20260811 07:02:46.739064 3827 ts_manager.cc:194] Registered new tserver with Master: 9ffae33977a94765ac2cf0b0b41ee44e (127.30.73.65:37909)
W20260811 07:02:47.080699 4049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:47.080996 4049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:47.081161 4049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:47.088764 4049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:47.088871 4049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:47.089049 4049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:47.098398 4049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:41217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:47.099773 4049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:47.101632 4049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:47.115340 4054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:47.115303 4055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:47.115260 4057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:47.116214 4049 server_base.cc:1034] running on GCE node
I20260811 07:02:47.116871 4049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:47.117959 4049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:47.119235 4049 hybrid_clock.cc:648] HybridClock initialized: now 1786431767119188 us; error 59 us; skew 500 ppm
I20260811 07:02:47.119585 4049 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:02:47.121963 4049 webserver.cc:460] Webserver started at http://127.30.73.66:43657/ using document root <none> and password file <none>
I20260811 07:02:47.122676 4049 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:47.122810 4049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:47.123159 4049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:47.126199 4049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "01d1f5296035423a84fc11a3e3d2f906"
format_stamp: "Formatted at 2026-08-11 07:02:47 on dist-test-slave-69rg"
server_key: "4e91277e49adc27fa9c9782a0eae2263"
server_key_iv: "fc03c30ffb5fe0c5af3cd972e312a27c"
server_key_version: "encryptionkey@0"
I20260811 07:02:47.127012 4049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "01d1f5296035423a84fc11a3e3d2f906"
format_stamp: "Formatted at 2026-08-11 07:02:47 on dist-test-slave-69rg"
server_key: "4e91277e49adc27fa9c9782a0eae2263"
server_key_iv: "fc03c30ffb5fe0c5af3cd972e312a27c"
server_key_version: "encryptionkey@0"
I20260811 07:02:47.132467 4049 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 07:02:47.136059 4063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:47.137436 4049 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:02:47.137603 4049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "01d1f5296035423a84fc11a3e3d2f906"
format_stamp: "Formatted at 2026-08-11 07:02:47 on dist-test-slave-69rg"
server_key: "4e91277e49adc27fa9c9782a0eae2263"
server_key_iv: "fc03c30ffb5fe0c5af3cd972e312a27c"
server_key_version: "encryptionkey@0"
I20260811 07:02:47.137873 4049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:47.143432 4049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:47.144194 4049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:47.144464 4049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:47.145372 4049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:47.146854 4049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:47.146987 4049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:47.147114 4049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:47.147215 4049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:47.181598 4049 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:38645
I20260811 07:02:47.181701 4190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:38645 every 8 connection(s)
I20260811 07:02:47.183117 4049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:47.191493 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 4049
I20260811 07:02:47.191694 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:47.191864 4047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.185848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:37781 (local address 127.30.73.126:36357)
0811 07:02:47.186033 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:47.186037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:47.187455 (+ 1418us) server_negotiation.cc:407] Connection header received
0811 07:02:47.189334 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:47.189340 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:47.189429 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:47.189540 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:47.190950 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:47.190956 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:47.190961 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:47.190987 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:47.191017 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:47.191053 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:47.191194 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:47.191463 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 07:02:47.191522 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:02:47.192303 31013 external_mini_cluster.cc:1428] Setting key 64bb0d546387e85583e3520024840849
I20260811 07:02:47.193135 4193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.186314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36357 (local address 127.30.73.66:37781)
0811 07:02:47.187292 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:47.187335 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:47.189059 (+ 1724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:47.189783 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:47.189791 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:47.189943 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:47.190610 (+ 667us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:02:47.190613 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:47.190653 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:02:47.190758 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:47.191178 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:47.191191 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:47.191201 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:02:47.191524 (+ 323us) client_negotiation.cc:240] Negotiation successful
0811 07:02:47.191821 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":287,"threads_started":1}
I20260811 07:02:47.194602 4191 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36357
I20260811 07:02:47.194923 4191 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:47.195523 4191 heartbeater.cc:511] Master 127.30.73.126:36357 requested a full tablet report, sending...
I20260811 07:02:47.195523 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36357
--builtin_ntp_servers=127.30.73.84:41217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 07:02:47.196995 3827 ts_manager.cc:194] Registered new tserver with Master: 01d1f5296035423a84fc11a3e3d2f906 (127.30.73.66:38645)
W20260811 07:02:47.546283 4194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:47.546633 4194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:47.546806 4194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:47.554322 4194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:47.554487 4194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:47.554692 4194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:47.564247 4194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:41217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:47.565753 4194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:47.567765 4194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:47.583666 4200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:47.583763 4202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:47.583678 4199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:47.584966 4194 server_base.cc:1034] running on GCE node
I20260811 07:02:47.585758 4194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:47.587007 4194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:47.588267 4194 hybrid_clock.cc:648] HybridClock initialized: now 1786431767588210 us; error 53 us; skew 500 ppm
I20260811 07:02:47.588658 4194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:02:47.591495 4194 webserver.cc:460] Webserver started at http://127.30.73.67:38695/ using document root <none> and password file <none>
I20260811 07:02:47.592373 4194 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:47.592476 4194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:47.592819 4194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:47.595971 4194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "194f45debc164d52a3dcb953d0f28e25"
format_stamp: "Formatted at 2026-08-11 07:02:47 on dist-test-slave-69rg"
server_key: "8b6d7496cfd6b9309bc168b12de08383"
server_key_iv: "19fe4b955524b700f1fe8a5559849672"
server_key_version: "encryptionkey@0"
I20260811 07:02:47.596778 4194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "194f45debc164d52a3dcb953d0f28e25"
format_stamp: "Formatted at 2026-08-11 07:02:47 on dist-test-slave-69rg"
server_key: "8b6d7496cfd6b9309bc168b12de08383"
server_key_iv: "19fe4b955524b700f1fe8a5559849672"
server_key_version: "encryptionkey@0"
I20260811 07:02:47.602384 4194 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 07:02:47.606389 4210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:47.607836 4194 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:02:47.608052 4194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "194f45debc164d52a3dcb953d0f28e25"
format_stamp: "Formatted at 2026-08-11 07:02:47 on dist-test-slave-69rg"
server_key: "8b6d7496cfd6b9309bc168b12de08383"
server_key_iv: "19fe4b955524b700f1fe8a5559849672"
server_key_version: "encryptionkey@0"
I20260811 07:02:47.608325 4194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:47.614586 4194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:47.615479 4194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:47.615770 4194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:47.616801 4194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:47.618392 4194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:47.618515 4194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:47.618669 4194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:47.618762 4194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:47.654743 4194 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:38457
I20260811 07:02:47.654804 4344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:38457 every 8 connection(s)
I20260811 07:02:47.656155 4194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:47.660658 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 4194
I20260811 07:02:47.660837 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:47.661331 31013 external_mini_cluster.cc:1428] Setting key a1475ebce5fc931ab1eb429b07caa9a9
I20260811 07:02:47.665349 4047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.659180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:56615 (local address 127.30.73.126:36357)
0811 07:02:47.659411 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:47.659415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:47.660805 (+ 1390us) server_negotiation.cc:407] Connection header received
0811 07:02:47.662961 (+ 2156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:47.662968 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:47.663046 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:47.663175 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:47.664690 (+ 1515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:47.664697 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:47.664703 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:47.664725 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:47.664766 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:47.664788 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:47.664882 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:47.665069 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 07:02:47.665127 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:02:47.666348 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.659685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36357 (local address 127.30.73.67:56615)
0811 07:02:47.660626 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:47.660678 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:47.662676 (+ 1998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:47.663486 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:47.663496 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:47.663586 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:47.664297 (+ 711us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:02:47.664300 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:47.664377 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:02:47.664497 (+ 120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:47.664882 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:47.664890 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:47.664896 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:02:47.665113 (+ 217us) client_negotiation.cc:240] Negotiation successful
0811 07:02:47.665299 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":285,"threads_started":1}
I20260811 07:02:47.667737 4345 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36357
I20260811 07:02:47.668007 4345 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:47.668573 4345 heartbeater.cc:511] Master 127.30.73.126:36357 requested a full tablet report, sending...
I20260811 07:02:47.670042 3827 ts_manager.cc:194] Registered new tserver with Master: 194f45debc164d52a3dcb953d0f28e25 (127.30.73.67:38457)
I20260811 07:02:47.678150 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:02:47.686419 4047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.683107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46906 (local address 127.30.73.126:36357)
0811 07:02:47.683320 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:47.683325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:47.683935 (+ 610us) server_negotiation.cc:407] Connection header received
0811 07:02:47.684069 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:47.684073 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:47.684139 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:47.684243 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:47.685558 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:47.685563 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:47.685567 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:47.685586 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:47.685626 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:47.685640 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:47.685769 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:47.685948 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 07:02:47.686027 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:02:47.691062 3827 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:02:47.699340 3827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:02:47.719282 4358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.711985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:38457 (local address 127.0.0.1:51202)
0811 07:02:47.713118 (+ 1133us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:47.713186 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:47.713468 (+ 282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:47.715651 (+ 2183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:47.715660 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:47.715764 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:47.717095 (+ 1331us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:02:47.717099 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:47.717116 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:02:47.717162 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:47.718489 (+ 1327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:47.718501 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:47.718511 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:02:47.718676 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 07:02:47.718772 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":436,"threads_started":1}
I20260811 07:02:47.719924 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.713215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36888 (local address 127.30.73.65:37909)
0811 07:02:47.714559 (+ 1344us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:47.714573 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:47.715056 (+ 483us) server_negotiation.cc:407] Connection header received
0811 07:02:47.715159 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:47.715167 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:47.715418 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:47.717292 (+ 1874us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:47.718424 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:47.718435 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:47.718450 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:47.718472 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:47.718527 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:47.718548 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:47.719274 (+ 726us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:47.719354 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 07:02:47.719473 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1119,"thread_start_us":943,"threads_started":1}
I20260811 07:02:47.719945 4362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.714952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:38645 (local address 127.0.0.1:59428)
0811 07:02:47.715464 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:47.715482 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:47.715569 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:47.717427 (+ 1858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:47.717432 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:47.717454 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:47.718144 (+ 690us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:02:47.718150 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:47.718169 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:02:47.718212 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:47.719281 (+ 1069us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:47.719287 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:47.719292 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:02:47.719424 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 07:02:47.719482 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":691,"threads_started":1}
I20260811 07:02:47.720459 4360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.712481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.0.0.1:36888)
0811 07:02:47.714875 (+ 2394us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:47.714893 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:47.715002 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:47.715651 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:47.715660 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:47.715764 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:47.716673 (+ 909us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:02:47.716678 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:47.716757 (+ 79us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:02:47.716868 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:47.718679 (+ 1811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:47.718685 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:47.718690 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:02:47.718814 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 07:02:47.718858 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2232,"thread_start_us":2084,"threads_started":1}
I20260811 07:02:47.720995 4359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.712315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51202 (local address 127.30.73.67:38457)
0811 07:02:47.715122 (+ 2807us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:47.715129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:47.715158 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:02:47.715224 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:47.715230 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:47.715417 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:47.716121 (+ 704us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:47.718205 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:47.718218 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:47.718233 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:47.718253 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:47.718322 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:47.718346 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:47.720392 (+ 2046us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:47.720474 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 07:02:47.720582 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2649,"thread_start_us":2467,"threads_started":1}
I20260811 07:02:47.721166 4363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.715508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59428 (local address 127.30.73.66:38645)
0811 07:02:47.715999 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:47.716013 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:47.716068 (+ 55us) server_negotiation.cc:407] Connection header received
0811 07:02:47.716138 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:47.716144 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:47.716356 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:47.717881 (+ 1525us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:47.719036 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:47.719043 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:47.719055 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:47.719069 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:47.719117 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:47.719136 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:47.720682 (+ 1546us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:47.720750 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 07:02:47.720862 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":289,"threads_started":1}
I20260811 07:02:47.725068 4117 tablet_service.cc:1467] Processing CreateTablet for tablet 1c121b56766244d9ab3dffa1ad170734 (DEFAULT_TABLE table=test-table [id=19a44edf91104da2bd28bf6d51d92ae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:47.725055 4272 tablet_service.cc:1467] Processing CreateTablet for tablet 1c121b56766244d9ab3dffa1ad170734 (DEFAULT_TABLE table=test-table [id=19a44edf91104da2bd28bf6d51d92ae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:47.725266 3969 tablet_service.cc:1467] Processing CreateTablet for tablet 1c121b56766244d9ab3dffa1ad170734 (DEFAULT_TABLE table=test-table [id=19a44edf91104da2bd28bf6d51d92ae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:02:47.726558 4272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c121b56766244d9ab3dffa1ad170734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:47.726612 3969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c121b56766244d9ab3dffa1ad170734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:47.726617 4117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c121b56766244d9ab3dffa1ad170734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:47.740525 4364 tablet_bootstrap.cc:492] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: Bootstrap starting.
I20260811 07:02:47.742386 4045 heartbeater.cc:503] Master 127.30.73.126:36357 was elected leader, sending a full tablet report...
I20260811 07:02:47.742717 4365 tablet_bootstrap.cc:492] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: Bootstrap starting.
I20260811 07:02:47.746613 4365 tablet_bootstrap.cc:654] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:47.747287 4364 tablet_bootstrap.cc:654] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:47.747911 4366 tablet_bootstrap.cc:492] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e: Bootstrap starting.
I20260811 07:02:47.747998 4365 log.cc:824] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:47.748700 4364 log.cc:824] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:47.751647 4366 tablet_bootstrap.cc:654] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:47.752139 4364 tablet_bootstrap.cc:492] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: No bootstrap required, opened a new log
I20260811 07:02:47.752130 4365 tablet_bootstrap.cc:492] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: No bootstrap required, opened a new log
I20260811 07:02:47.752444 4365 ts_tablet_manager.cc:1397] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 07:02:47.752444 4364 ts_tablet_manager.cc:1397] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260811 07:02:47.752954 4366 log.cc:824] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:47.756856 4366 tablet_bootstrap.cc:492] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e: No bootstrap required, opened a new log
I20260811 07:02:47.757135 4366 ts_tablet_manager.cc:1397] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260811 07:02:47.763911 4366 raft_consensus.cc:348] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } }
I20260811 07:02:47.764302 4366 raft_consensus.cc:374] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:47.764418 4366 raft_consensus.cc:729] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ffae33977a94765ac2cf0b0b41ee44e, State: Initialized, Role: FOLLOWER
I20260811 07:02:47.764710 4365 raft_consensus.cc:348] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } }
I20260811 07:02:47.764710 4364 raft_consensus.cc:348] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } }
I20260811 07:02:47.765184 4364 raft_consensus.cc:374] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:47.765184 4365 raft_consensus.cc:374] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:47.765305 4365 raft_consensus.cc:729] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 194f45debc164d52a3dcb953d0f28e25, State: Initialized, Role: FOLLOWER
I20260811 07:02:47.765305 4364 raft_consensus.cc:729] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01d1f5296035423a84fc11a3e3d2f906, State: Initialized, Role: FOLLOWER
I20260811 07:02:47.765120 4366 consensus_queue.cc:260] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } }
I20260811 07:02:47.766098 4365 consensus_queue.cc:260] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } }
I20260811 07:02:47.766098 4364 consensus_queue.cc:260] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } }
I20260811 07:02:47.768685 4191 heartbeater.cc:503] Master 127.30.73.126:36357 was elected leader, sending a full tablet report...
I20260811 07:02:47.768976 4365 ts_tablet_manager.cc:1428] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260811 07:02:47.769263 4364 ts_tablet_manager.cc:1428] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: Time spent starting tablet: real 0.017s user 0.018s sys 0.000s
I20260811 07:02:47.769742 4345 heartbeater.cc:503] Master 127.30.73.126:36357 was elected leader, sending a full tablet report...
I20260811 07:02:47.771637 4366 ts_tablet_manager.cc:1428] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e: Time spent starting tablet: real 0.014s user 0.008s sys 0.006s
W20260811 07:02:47.908142 4346 tablet.cc:2369] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:02:47.935484 4192 tablet.cc:2369] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:02:47.972571 4046 tablet.cc:2369] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:02:47.986850 4372 raft_consensus.cc:482] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:02:47.987139 4372 raft_consensus.cc:504] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } }
I20260811 07:02:47.988870 4372 leader_election.cc:288] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ffae33977a94765ac2cf0b0b41ee44e (127.30.73.65:37909), 01d1f5296035423a84fc11a3e3d2f906 (127.30.73.66:38645)
I20260811 07:02:47.991776 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.989125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.30.73.67:41141)
0811 07:02:47.989358 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:47.989377 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:47.989527 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:47.990025 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:47.990030 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:47.990059 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:47.990838 (+ 779us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:02:47.990841 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:47.990859 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:02:47.990902 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:47.991311 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:47.991316 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:47.991323 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:02:47.991458 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 07:02:47.991518 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 07:02:47.991780 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.989254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:41141 (local address 127.30.73.65:37909)
0811 07:02:47.989468 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:47.989476 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:47.989500 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:02:47.989714 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:47.989721 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:47.989845 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:47.989967 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:47.991067 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:47.991075 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:47.991082 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:47.991107 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:47.991149 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:47.991166 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:47.991312 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:47.991461 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 07:02:47.991520 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:02:47.992792 3991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c121b56766244d9ab3dffa1ad170734" candidate_uuid: "194f45debc164d52a3dcb953d0f28e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" is_pre_election: true
I20260811 07:02:47.992998 4363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.989704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:55229 (local address 127.30.73.66:38645)
0811 07:02:47.989946 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:47.989952 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:47.990321 (+ 369us) server_negotiation.cc:407] Connection header received
0811 07:02:47.990487 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:47.990492 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:47.990543 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:47.990668 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:47.992346 (+ 1678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:47.992353 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:47.992357 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:47.992377 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:47.992417 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:47.992458 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:47.992574 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:47.992656 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 07:02:47.992717 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:02:47.993137 4373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:47.989500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:38645 (local address 127.30.73.67:55229)
0811 07:02:47.990208 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:47.990227 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:47.990331 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:47.990722 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:47.990726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:47.990744 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:47.992134 (+ 1390us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:02:47.992137 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:47.992150 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:02:47.992188 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:47.992547 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:47.992552 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:47.992557 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:02:47.992671 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 07:02:47.992730 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":440,"threads_started":1}
I20260811 07:02:47.993366 3991 raft_consensus.cc:2454] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 194f45debc164d52a3dcb953d0f28e25 in term 0.
I20260811 07:02:47.994094 4216 leader_election.cc:302] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 194f45debc164d52a3dcb953d0f28e25, 9ffae33977a94765ac2cf0b0b41ee44e; no voters:
I20260811 07:02:47.994160 4138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c121b56766244d9ab3dffa1ad170734" candidate_uuid: "194f45debc164d52a3dcb953d0f28e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01d1f5296035423a84fc11a3e3d2f906" is_pre_election: true
I20260811 07:02:47.994510 4372 raft_consensus.cc:2781] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:02:47.994674 4372 raft_consensus.cc:482] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:02:47.994791 4372 raft_consensus.cc:3037] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:47.994750 4138 raft_consensus.cc:2454] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 194f45debc164d52a3dcb953d0f28e25 in term 0.
I20260811 07:02:47.997083 4372 raft_consensus.cc:504] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } }
I20260811 07:02:47.997598 4372 leader_election.cc:288] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [CANDIDATE]: Term 1 election: Requested vote from peers 9ffae33977a94765ac2cf0b0b41ee44e (127.30.73.65:37909), 01d1f5296035423a84fc11a3e3d2f906 (127.30.73.66:38645)
I20260811 07:02:47.998095 3991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c121b56766244d9ab3dffa1ad170734" candidate_uuid: "194f45debc164d52a3dcb953d0f28e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ffae33977a94765ac2cf0b0b41ee44e"
I20260811 07:02:47.998175 4138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c121b56766244d9ab3dffa1ad170734" candidate_uuid: "194f45debc164d52a3dcb953d0f28e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01d1f5296035423a84fc11a3e3d2f906"
I20260811 07:02:47.998324 3991 raft_consensus.cc:3037] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:47.998353 4138 raft_consensus.cc:3037] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:48.001645 3991 raft_consensus.cc:2454] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 194f45debc164d52a3dcb953d0f28e25 in term 1.
I20260811 07:02:48.001642 4138 raft_consensus.cc:2454] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 194f45debc164d52a3dcb953d0f28e25 in term 1.
I20260811 07:02:48.002135 4216 leader_election.cc:302] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 194f45debc164d52a3dcb953d0f28e25, 9ffae33977a94765ac2cf0b0b41ee44e; no voters:
I20260811 07:02:48.002453 4372 raft_consensus.cc:2781] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:48.002918 4372 raft_consensus.cc:686] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 1 LEADER]: Becoming Leader. State: Replica: 194f45debc164d52a3dcb953d0f28e25, State: Running, Role: LEADER
I20260811 07:02:48.003455 4372 consensus_queue.cc:237] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } }
I20260811 07:02:48.008234 3825 catalog_manager.cc:5495] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 194f45debc164d52a3dcb953d0f28e25 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "194f45debc164d52a3dcb953d0f28e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "194f45debc164d52a3dcb953d0f28e25" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 38457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260811 07:02:48.092413 4359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.089871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51216 (local address 127.30.73.67:38457)
0811 07:02:48.090083 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:48.090088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:48.090146 (+ 58us) server_negotiation.cc:407] Connection header received
0811 07:02:48.090337 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:48.090341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:48.090422 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:48.090507 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:48.091639 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:48.091644 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:48.091647 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:48.091664 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:48.091698 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:48.091711 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:48.091821 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:48.092003 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 07:02:48.092174 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 07:02:48.101245 4138 raft_consensus.cc:1261] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [term 1 FOLLOWER]: Refusing update from remote peer 194f45debc164d52a3dcb953d0f28e25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:48.101255 3991 raft_consensus.cc:1261] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e [term 1 FOLLOWER]: Refusing update from remote peer 194f45debc164d52a3dcb953d0f28e25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:02:48.102447 4374 consensus_queue.cc:1035] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01d1f5296035423a84fc11a3e3d2f906" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:48.102849 4372 consensus_queue.cc:1035] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ffae33977a94765ac2cf0b0b41ee44e" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:02:48.133788 3826 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:48.134168 3826 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:02:48.138693 3826 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8e390c91feb4826b38a4bf4d4ceb086: Sending DeleteTablet for 3 replicas of tablet 1c121b56766244d9ab3dffa1ad170734
I20260811 07:02:48.139917 4272 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c121b56766244d9ab3dffa1ad170734 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:48 UTC) from {username='slave'} at 127.0.0.1:51202
I20260811 07:02:48.139961 3969 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c121b56766244d9ab3dffa1ad170734 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:48 UTC) from {username='slave'} at 127.0.0.1:36888
I20260811 07:02:48.140617 4117 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c121b56766244d9ab3dffa1ad170734 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:02:48 UTC) from {username='slave'} at 127.0.0.1:59428
I20260811 07:02:48.142865 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 3896
I20260811 07:02:48.154359 4391 tablet_replica.cc:330] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: stopping tablet replica
I20260811 07:02:48.154794 4391 raft_consensus.cc:2229] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:02:48.155268 4391 raft_consensus.cc:2258] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:48.157624 4391 ts_tablet_manager.cc:1905] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:48.164192 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.144576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36902 (local address 127.30.73.65:37909)
0811 07:02:48.144822 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:48.144831 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:48.149476 (+ 4645us) server_negotiation.cc:407] Connection header received
0811 07:02:48.149656 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:48.149703 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:48.149884 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:48.150015 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:48.162789 (+ 12774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:48.162800 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:48.162807 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:48.162840 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:48.162899 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:48.162921 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:48.163071 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:48.163621 (+ 550us) server_negotiation.cc:299] Negotiation successful
0811 07:02:48.163728 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:02:48.165578 4039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:48.166064 4391 ts_tablet_manager.cc:1918] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:02:48.166296 4391 log.cc:1196] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/1c121b56766244d9ab3dffa1ad170734
I20260811 07:02:48.167011 4391 ts_tablet_manager.cc:1939] T 1c121b56766244d9ab3dffa1ad170734 P 01d1f5296035423a84fc11a3e3d2f906: Deleting consensus metadata
I20260811 07:02:48.169149 3814 catalog_manager.cc:4841] TS 01d1f5296035423a84fc11a3e3d2f906 (127.30.73.66:38645): tablet 1c121b56766244d9ab3dffa1ad170734 (table test-table [id=19a44edf91104da2bd28bf6d51d92ae0]) successfully deleted
I20260811 07:02:48.174839 4388 tablet_replica.cc:330] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: stopping tablet replica
I20260811 07:02:48.175371 4388 raft_consensus.cc:2229] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:02:48.176143 4388 raft_consensus.cc:2258] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:02:48.178433 4388 ts_tablet_manager.cc:1905] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:02:48.186297 4388 ts_tablet_manager.cc:1918] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:02:48.186630 4388 log.cc:1196] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/1c121b56766244d9ab3dffa1ad170734
I20260811 07:02:48.187266 4388 ts_tablet_manager.cc:1939] T 1c121b56766244d9ab3dffa1ad170734 P 194f45debc164d52a3dcb953d0f28e25: Deleting consensus metadata
I20260811 07:02:48.189234 3812 catalog_manager.cc:4841] TS 194f45debc164d52a3dcb953d0f28e25 (127.30.73.67:38457): tablet 1c121b56766244d9ab3dffa1ad170734 (table test-table [id=19a44edf91104da2bd28bf6d51d92ae0]) successfully deleted
I20260811 07:02:48.279770 4389 tablet_replica.cc:330] T 1c121b56766244d9ab3dffa1ad170734 P 9ffae33977a94765ac2cf0b0b41ee44e: stopping tablet replica
I20260811 07:02:48.280040 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 3896
I20260811 07:02:48.301482 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 4049
W20260811 07:02:48.301450 3814 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.73.65:37909 (error 108)
I20260811 07:02:48.303993 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.302953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.0.0.1:36912)
0811 07:02:48.303621 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:48.303769 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:37909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":442,"threads_started":1}
W20260811 07:02:48.304560 3814 catalog_manager.cc:4584] TS 9ffae33977a94765ac2cf0b0b41ee44e (127.30.73.65:37909): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1c121b56766244d9ab3dffa1ad170734: Network error: Client connection negotiation failed: client connection to 127.30.73.65:37909: connect: Connection refused (error 111)
I20260811 07:02:48.304916 4363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.302449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59432 (local address 127.30.73.66:38645)
0811 07:02:48.302673 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:48.302680 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:48.302702 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:02:48.302893 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:48.302900 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:48.303015 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:48.303152 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:48.304168 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:48.304174 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:48.304178 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:48.304200 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:48.304242 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:48.304259 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:48.304401 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:48.304541 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 07:02:48.304605 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:02:48.305668 4186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:48.358420 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.357857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.0.0.1:36926)
0811 07:02:48.358115 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:48.358248 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:37909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 07:02:48.359679 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.359242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.0.0.1:36932)
0811 07:02:48.359423 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:48.359515 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:37909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 07:02:48.395833 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 4049
I20260811 07:02:48.420354 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.419906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.0.0.1:36934)
0811 07:02:48.420122 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:48.420207 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:37909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 07:02:48.421437 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.421087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.0.0.1:36946)
0811 07:02:48.421236 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:48.421315 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:37909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 07:02:48.424952 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 4194
I20260811 07:02:48.428160 4359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.426059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51220 (local address 127.30.73.67:38457)
0811 07:02:48.426226 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:48.426232 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:48.426251 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:02:48.426330 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:48.426334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:48.426389 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:48.426471 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:48.427420 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:48.427425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:48.427428 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:48.427447 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:48.427482 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:48.427493 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:48.427605 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:48.427784 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 07:02:48.427834 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:02:48.428941 4339 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:48.502286 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.501767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.0.0.1:36960)
0811 07:02:48.502027 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:48.502123 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:37909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260811 07:02:48.503400 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.503001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.0.0.1:36974)
0811 07:02:48.503187 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:48.503270 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:37909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260811 07:02:48.548826 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 4194
I20260811 07:02:48.575852 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 3794
I20260811 07:02:48.577481 3864 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:48.687134 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:48.685681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:37909 (local address 127.0.0.1:36982)
0811 07:02:48.686762 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:48.686916 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:37909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":646}
I20260811 07:02:48.687361 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 3794
2026-08-11T07:02:48Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3131 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 07:02:48.734592 31013 mini_oidc.cc:152] Starting JWKS server
I20260811 07:02:48.740343 31013 webserver.cc:460] Webserver started at https://127.0.0.1:33735/ using document root <none> and password file <none>
I20260811 07:02:48.740748 31013 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:02:48.741470 31013 webserver.cc:460] Webserver started at http://127.0.0.1:37313/ using document root <none> and password file <none>
2026-08-11T07:02:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:48Z Disabled control of system clock
I20260811 07:02:48.779064 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40775
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:46625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:40775
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33735/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/testchainca.cert with env {}
W20260811 07:02:49.125280 4407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:49.125581 4407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:49.125764 4407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:49.133183 4407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:49.133306 4407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:49.133380 4407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:49.133468 4407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:49.133530 4407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:02:49.133663 4407 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:02:49.133719 4407 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33735/jwks.json
I20260811 07:02:49.144767 4407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:46625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:40775
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33735/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:49.146152 4407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:49.147521 4407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:49.158891 4415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:49.159109 4414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:49.160530 4417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:49.160979 4407 server_base.cc:1034] running on GCE node
I20260811 07:02:49.161789 4407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:49.163266 4407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:49.164511 4407 hybrid_clock.cc:648] HybridClock initialized: now 1786431769164490 us; error 49 us; skew 500 ppm
I20260811 07:02:49.164984 4407 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:02:49.167454 4407 webserver.cc:460] Webserver started at http://127.30.73.126:46469/ using document root <none> and password file <none>
I20260811 07:02:49.168197 4407 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:49.168344 4407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:49.168673 4407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:49.171708 4407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "b85886aedc0648189f0b58749b96dadd"
format_stamp: "Formatted at 2026-08-11 07:02:49 on dist-test-slave-69rg"
server_key: "a4cd0a1696b19f1e37c0403b0fdac735"
server_key_iv: "2e2092b59744a7dcfaf94a2dd39a112f"
server_key_version: "encryptionkey@0"
I20260811 07:02:49.172526 4407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "b85886aedc0648189f0b58749b96dadd"
format_stamp: "Formatted at 2026-08-11 07:02:49 on dist-test-slave-69rg"
server_key: "a4cd0a1696b19f1e37c0403b0fdac735"
server_key_iv: "2e2092b59744a7dcfaf94a2dd39a112f"
server_key_version: "encryptionkey@0"
I20260811 07:02:49.177736 4407 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:02:49.181289 4423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:49.182690 4407 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 07:02:49.182891 4407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "b85886aedc0648189f0b58749b96dadd"
format_stamp: "Formatted at 2026-08-11 07:02:49 on dist-test-slave-69rg"
server_key: "a4cd0a1696b19f1e37c0403b0fdac735"
server_key_iv: "2e2092b59744a7dcfaf94a2dd39a112f"
server_key_version: "encryptionkey@0"
I20260811 07:02:49.183122 4407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:49.199766 4407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:49.200670 4407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:49.201004 4407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:49.220428 4407 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:40775
I20260811 07:02:49.220448 4480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:40775 every 8 connection(s)
I20260811 07:02:49.221939 4407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:49.223981 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 4407
I20260811 07:02:49.224226 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:49.225045 31013 external_mini_cluster.cc:1428] Setting key 8ee7203cbc9bb5341dea6a1125f0ed1f
I20260811 07:02:49.226874 4481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:49.239935 4484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:49.227302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57038 (local address 127.30.73.126:40775)
0811 07:02:49.228371 (+ 1069us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:49.228383 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:49.228453 (+ 70us) server_negotiation.cc:407] Connection header received
0811 07:02:49.230479 (+ 2026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:49.230500 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:49.230964 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:49.231318 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:49.231973 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:49.233370 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:49.235341 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:49.236000 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:49.236134 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:49.237450 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:49.237458 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:49.237471 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:49.238143 (+ 672us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:49.238222 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:49.238247 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:49.238346 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:49.238593 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 07:02:49.238972 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":409,"threads_started":1}
I20260811 07:02:49.240929 4481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd: Bootstrap starting.
I20260811 07:02:49.243955 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:02:49.244490 4481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:49.245477 4481 log.cc:824] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:49.248483 4481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd: No bootstrap required, opened a new log
I20260811 07:02:49.256278 4481 raft_consensus.cc:348] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85886aedc0648189f0b58749b96dadd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40775 } }
I20260811 07:02:49.256706 4481 raft_consensus.cc:374] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:49.256773 4481 raft_consensus.cc:729] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85886aedc0648189f0b58749b96dadd, State: Initialized, Role: FOLLOWER
I20260811 07:02:49.257289 4481 consensus_queue.cc:260] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85886aedc0648189f0b58749b96dadd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40775 } }
I20260811 07:02:49.257503 4481 raft_consensus.cc:388] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:49.257606 4481 raft_consensus.cc:482] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:49.257740 4481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:49.260217 4481 raft_consensus.cc:504] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85886aedc0648189f0b58749b96dadd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40775 } }
I20260811 07:02:49.260703 4481 leader_election.cc:302] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b85886aedc0648189f0b58749b96dadd; no voters:
I20260811 07:02:49.261291 4481 leader_election.cc:288] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:49.261466 4486 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:49.262264 4486 raft_consensus.cc:686] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [term 1 LEADER]: Becoming Leader. State: Replica: b85886aedc0648189f0b58749b96dadd, State: Running, Role: LEADER
I20260811 07:02:49.262782 4486 consensus_queue.cc:237] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85886aedc0648189f0b58749b96dadd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40775 } }
I20260811 07:02:49.263494 4481 sys_catalog.cc:564] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:49.266044 4487 sys_catalog.cc:455] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b85886aedc0648189f0b58749b96dadd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85886aedc0648189f0b58749b96dadd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40775 } } }
I20260811 07:02:49.266137 4488 sys_catalog.cc:455] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b85886aedc0648189f0b58749b96dadd. Latest consensus state: current_term: 1 leader_uuid: "b85886aedc0648189f0b58749b96dadd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85886aedc0648189f0b58749b96dadd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40775 } } }
I20260811 07:02:49.266484 4487 sys_catalog.cc:458] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:49.266559 4488 sys_catalog.cc:458] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:49.268873 4495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:49.274155 4495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:49.283489 4495 catalog_manager.cc:1347] Generated new cluster ID: 2e4cb34b315b497fb654fb0e6a12e927
I20260811 07:02:49.283615 4495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:49.310932 4495 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:49.312285 4495 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:49.319990 4495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b85886aedc0648189f0b58749b96dadd: Generated new TSK 0
I20260811 07:02:49.321023 4495 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 07:02:49.371013 4514 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 07:02:49.371220 4514 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 07:02:49.373119 4484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:49.341119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57046 (local address 127.30.73.126:40775)
0811 07:02:49.341340 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:49.341351 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:49.342144 (+ 793us) server_negotiation.cc:407] Connection header received
0811 07:02:49.342556 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:49.342561 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:49.342654 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:49.342802 (+ 148us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:02:49.343516 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:49.344281 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:49.346461 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:49.346943 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:49.347050 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:49.347799 (+ 749us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:02:49.372506 (+ 24707us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 07:02:49.372859 (+ 353us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57046: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 07:02:49.373293 4484 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57046: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 07:02:49.375465 4513 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:02:49.341195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40775 (local address 127.0.0.1:57046)
0811 07:02:49.342002 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:49.342024 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:49.342245 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:49.342863 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:49.342868 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:49.342882 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:02:49.343320 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:49.343333 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:49.344434 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:49.344440 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:49.346282 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:49.346298 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:49.347147 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:49.347154 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:49.347368 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:49.347461 (+ 93us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:02:49.372882 (+ 25421us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 07:02:49.373289 (+ 407us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.73.126:40775: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":360,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.30.73.126:40775: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 07:02:49.377312 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 4407
I20260811 07:02:49.378759 4476 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:49.476277 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 4407
2026-08-11T07:02:49Z chronyd exiting
I20260811 07:02:49.531513 31013 test_util.cc:175] -----------------------------------------------
I20260811 07:02:49.531701 31013 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786431722204153-31013-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (802 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 07:02:49.535800 31013 mini_oidc.cc:152] Starting JWKS server
I20260811 07:02:49.537694 31013 webserver.cc:460] Webserver started at https://127.0.0.1:39893/ using document root <none> and password file <none>
I20260811 07:02:49.537977 31013 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:02:49.538731 31013 webserver.cc:460] Webserver started at http://127.0.0.1:35395/ using document root <none> and password file <none>
2026-08-11T07:02:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:49Z Disabled control of system clock
I20260811 07:02:49.574688 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35997
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:38849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:35997
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39893/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/testchainca.cert with env {}
W20260811 07:02:49.913892 4521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:49.914269 4521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:49.914427 4521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:49.921841 4521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:49.921994 4521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:49.922091 4521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:49.922196 4521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:49.922282 4521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:02:49.922372 4521 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:02:49.922451 4521 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39893/jwks.json
I20260811 07:02:49.932281 4521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:38849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:35997
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39893/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:49.933596 4521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:49.934969 4521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:49.947419 4527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:49.947459 4528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:49.947427 4530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:49.949007 4521 server_base.cc:1034] running on GCE node
I20260811 07:02:49.950016 4521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:49.951579 4521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:49.952849 4521 hybrid_clock.cc:648] HybridClock initialized: now 1786431769952800 us; error 43 us; skew 500 ppm
I20260811 07:02:49.953265 4521 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:02:49.955753 4521 webserver.cc:460] Webserver started at http://127.30.73.126:39493/ using document root <none> and password file <none>
I20260811 07:02:49.956496 4521 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:49.956643 4521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:49.956996 4521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:49.960080 4521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "e23ca50601fc42898a4ebad9223f8b6d"
format_stamp: "Formatted at 2026-08-11 07:02:49 on dist-test-slave-69rg"
server_key: "07b09378bd17cceb4936ceea3f1aefe1"
server_key_iv: "ad774c010d7a7e1d2f0754d11e6392aa"
server_key_version: "encryptionkey@0"
I20260811 07:02:49.960916 4521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "e23ca50601fc42898a4ebad9223f8b6d"
format_stamp: "Formatted at 2026-08-11 07:02:49 on dist-test-slave-69rg"
server_key: "07b09378bd17cceb4936ceea3f1aefe1"
server_key_iv: "ad774c010d7a7e1d2f0754d11e6392aa"
server_key_version: "encryptionkey@0"
I20260811 07:02:49.966463 4521 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:02:49.969966 4537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:49.971477 4521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:02:49.971657 4521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "e23ca50601fc42898a4ebad9223f8b6d"
format_stamp: "Formatted at 2026-08-11 07:02:49 on dist-test-slave-69rg"
server_key: "07b09378bd17cceb4936ceea3f1aefe1"
server_key_iv: "ad774c010d7a7e1d2f0754d11e6392aa"
server_key_version: "encryptionkey@0"
I20260811 07:02:49.971879 4521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:50.003355 4521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:50.004268 4521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:50.004611 4521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:50.025159 4521 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:35997
I20260811 07:02:50.025172 4595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:35997 every 8 connection(s)
I20260811 07:02:50.026711 4521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:50.030550 4596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:50.036901 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 4521
I20260811 07:02:50.037098 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:50.037985 31013 external_mini_cluster.cc:1428] Setting key 2d9ab952973de6c1631ce4c01530c5cb
I20260811 07:02:50.042291 4596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d: Bootstrap starting.
I20260811 07:02:50.045600 4596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:50.046685 4596 log.cc:824] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:50.050132 4596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d: No bootstrap required, opened a new log
I20260811 07:02:50.051748 4601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:50.040075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40648 (local address 127.30.73.126:35997)
0811 07:02:50.041101 (+ 1026us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:50.041112 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:50.041150 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:02:50.042905 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:50.042927 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:50.043343 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:50.043733 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:50.044293 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.045541 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.046887 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.048007 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.048227 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:50.049452 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:50.049459 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:50.049473 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:50.050065 (+ 592us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:50.050145 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:50.050171 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:50.050301 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:50.050536 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 07:02:50.050841 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":345,"threads_started":1}
I20260811 07:02:50.055567 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:02:50.058379 4596 raft_consensus.cc:348] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23ca50601fc42898a4ebad9223f8b6d" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35997 } }
I20260811 07:02:50.058763 4596 raft_consensus.cc:374] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:50.058895 4596 raft_consensus.cc:729] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23ca50601fc42898a4ebad9223f8b6d, State: Initialized, Role: FOLLOWER
I20260811 07:02:50.059588 4596 consensus_queue.cc:260] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23ca50601fc42898a4ebad9223f8b6d" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35997 } }
I20260811 07:02:50.059860 4596 raft_consensus.cc:388] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:50.060022 4596 raft_consensus.cc:482] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:50.060204 4596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:50.062526 4596 raft_consensus.cc:504] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23ca50601fc42898a4ebad9223f8b6d" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35997 } }
I20260811 07:02:50.063205 4596 leader_election.cc:302] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e23ca50601fc42898a4ebad9223f8b6d; no voters:
I20260811 07:02:50.064165 4596 leader_election.cc:288] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:50.064251 4603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:50.066527 4596 sys_catalog.cc:564] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:50.071086 4603 raft_consensus.cc:686] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [term 1 LEADER]: Becoming Leader. State: Replica: e23ca50601fc42898a4ebad9223f8b6d, State: Running, Role: LEADER
I20260811 07:02:50.071885 4603 consensus_queue.cc:237] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23ca50601fc42898a4ebad9223f8b6d" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35997 } }
I20260811 07:02:50.075160 4604 sys_catalog.cc:455] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e23ca50601fc42898a4ebad9223f8b6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23ca50601fc42898a4ebad9223f8b6d" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35997 } } }
I20260811 07:02:50.075130 4605 sys_catalog.cc:455] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e23ca50601fc42898a4ebad9223f8b6d. Latest consensus state: current_term: 1 leader_uuid: "e23ca50601fc42898a4ebad9223f8b6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23ca50601fc42898a4ebad9223f8b6d" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35997 } } }
I20260811 07:02:50.075626 4604 sys_catalog.cc:458] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:50.075687 4605 sys_catalog.cc:458] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:50.077939 4618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:50.083293 4618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:50.093343 4618 catalog_manager.cc:1347] Generated new cluster ID: a81a586dfb2c4925823be4d958d1c3b6
I20260811 07:02:50.093536 4618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:50.109716 4618 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:50.111025 4618 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:50.120127 4618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e23ca50601fc42898a4ebad9223f8b6d: Generated new TSK 0
I20260811 07:02:50.120985 4618 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 07:02:50.157754 4630 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 07:02:50.157938 4630 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 07:02:50.159198 4601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:50.139054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40662 (local address 127.30.73.126:35997)
0811 07:02:50.139244 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:50.139250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:50.139661 (+ 411us) server_negotiation.cc:407] Connection header received
0811 07:02:50.139843 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:50.139850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:50.139950 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:50.140125 (+ 175us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:02:50.140606 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.141783 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.143193 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.143902 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.144034 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:50.144495 (+ 461us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:02:50.158509 (+ 14014us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 07:02:50.158898 (+ 389us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40662: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 07:02:50.159226 4629 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:02:50.138895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35997 (local address 127.0.0.1:40662)
0811 07:02:50.139559 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:50.139578 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:50.139695 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:50.140131 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:50.140134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:50.140144 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:02:50.140424 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:50.140433 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.141963 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.141967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:50.143047 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:50.143058 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.144067 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.144071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:50.144204 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:50.144235 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:02:50.158736 (+ 14501us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 07:02:50.158941 (+ 205us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.73.126:35997: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":339,"threads_started":1}
W20260811 07:02:50.159327 4601 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40662: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260811 07:02:50.160398 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 4521
I20260811 07:02:50.161728 4591 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:50.256194 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 4521
2026-08-11T07:02:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (780 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 07:02:50.316540 31013 mini_oidc.cc:152] Starting JWKS server
I20260811 07:02:50.318725 31013 webserver.cc:460] Webserver started at https://127.0.0.1:41955/ using document root <none> and password file <none>
I20260811 07:02:50.318995 31013 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:02:50.319661 31013 webserver.cc:460] Webserver started at http://127.0.0.1:46745/ using document root <none> and password file <none>
2026-08-11T07:02:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:50Z Disabled control of system clock
I20260811 07:02:50.356074 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:46809
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:46809
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41955/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 07:02:50.699519 4639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:50.699920 4639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:50.700091 4639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:50.707808 4639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:50.707989 4639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:50.708084 4639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:50.708215 4639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:50.708297 4639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:02:50.708388 4639 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:02:50.708467 4639 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41955/jwks.json
I20260811 07:02:50.718199 4639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:46809
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:46809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41955/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:50.719738 4639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:50.721628 4639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:50.734822 4649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:50.734910 4647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:50.734833 4645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:50.739605 4639 server_base.cc:1034] running on GCE node
I20260811 07:02:50.740552 4639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:50.742350 4639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:50.743631 4639 hybrid_clock.cc:648] HybridClock initialized: now 1786431770743583 us; error 58 us; skew 500 ppm
I20260811 07:02:50.744102 4639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:02:50.747485 4639 webserver.cc:460] Webserver started at http://127.30.73.126:34835/ using document root <none> and password file <none>
I20260811 07:02:50.748312 4639 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:50.748416 4639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:50.748725 4639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:50.751940 4639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "183f9366ba54494a81f379e7c8e6e760"
format_stamp: "Formatted at 2026-08-11 07:02:50 on dist-test-slave-69rg"
server_key: "616ab3f03ce1ec4c6b3e7eba13306455"
server_key_iv: "d76ab71e2c7ac9083fbb5e21539f4cc9"
server_key_version: "encryptionkey@0"
I20260811 07:02:50.752770 4639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "183f9366ba54494a81f379e7c8e6e760"
format_stamp: "Formatted at 2026-08-11 07:02:50 on dist-test-slave-69rg"
server_key: "616ab3f03ce1ec4c6b3e7eba13306455"
server_key_iv: "d76ab71e2c7ac9083fbb5e21539f4cc9"
server_key_version: "encryptionkey@0"
I20260811 07:02:50.758782 4639 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:02:50.762671 4657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:50.764148 4639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:02:50.764393 4639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "183f9366ba54494a81f379e7c8e6e760"
format_stamp: "Formatted at 2026-08-11 07:02:50 on dist-test-slave-69rg"
server_key: "616ab3f03ce1ec4c6b3e7eba13306455"
server_key_iv: "d76ab71e2c7ac9083fbb5e21539f4cc9"
server_key_version: "encryptionkey@0"
I20260811 07:02:50.764640 4639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:50.778942 4639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:50.779843 4639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:50.780181 4639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:50.800120 4639 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:46809
I20260811 07:02:50.800139 4714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:46809 every 8 connection(s)
I20260811 07:02:50.801642 4639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:50.805881 4715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:50.810122 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 4639
I20260811 07:02:50.810392 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:50.811020 31013 external_mini_cluster.cc:1428] Setting key 4b4099da16cbc66641145490391a4e7f
I20260811 07:02:50.818115 4715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760: Bootstrap starting.
I20260811 07:02:50.822050 4715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:50.823474 4715 log.cc:824] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:50.826239 4720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:50.813187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59984 (local address 127.30.73.126:46809)
0811 07:02:50.814255 (+ 1068us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:50.814266 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:50.814309 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:02:50.816448 (+ 2139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:50.816475 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:50.816987 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:50.817346 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:50.818110 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.819562 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.821537 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.822390 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.822545 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:50.823866 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:50.823873 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:50.823888 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:50.824477 (+ 589us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:50.824555 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:50.824576 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:50.824738 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:50.824968 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 07:02:50.825259 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":412,"threads_started":1}
I20260811 07:02:50.826865 4715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760: No bootstrap required, opened a new log
I20260811 07:02:50.829973 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:02:50.835275 4715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "183f9366ba54494a81f379e7c8e6e760" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46809 } }
I20260811 07:02:50.835765 4715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:50.835879 4715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183f9366ba54494a81f379e7c8e6e760, State: Initialized, Role: FOLLOWER
I20260811 07:02:50.836470 4715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "183f9366ba54494a81f379e7c8e6e760" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46809 } }
I20260811 07:02:50.836772 4715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:50.836975 4715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:50.837170 4715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:50.839740 4715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "183f9366ba54494a81f379e7c8e6e760" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46809 } }
I20260811 07:02:50.840194 4715 leader_election.cc:302] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 183f9366ba54494a81f379e7c8e6e760; no voters:
I20260811 07:02:50.840826 4715 leader_election.cc:288] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:50.840992 4722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:50.841863 4722 raft_consensus.cc:686] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [term 1 LEADER]: Becoming Leader. State: Replica: 183f9366ba54494a81f379e7c8e6e760, State: Running, Role: LEADER
I20260811 07:02:50.842521 4722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "183f9366ba54494a81f379e7c8e6e760" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46809 } }
I20260811 07:02:50.843281 4715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:50.845695 4724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "183f9366ba54494a81f379e7c8e6e760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "183f9366ba54494a81f379e7c8e6e760" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46809 } } }
I20260811 07:02:50.845665 4726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 183f9366ba54494a81f379e7c8e6e760. Latest consensus state: current_term: 1 leader_uuid: "183f9366ba54494a81f379e7c8e6e760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "183f9366ba54494a81f379e7c8e6e760" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46809 } } }
I20260811 07:02:50.846189 4724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:50.846220 4726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:50.854139 4729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:50.859738 4729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:50.869691 4729 catalog_manager.cc:1347] Generated new cluster ID: 27051d2d34e44aeb8234ca4e498c72a3
I20260811 07:02:50.869874 4729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:50.890856 4729 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:50.892591 4729 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:50.901294 4729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 183f9366ba54494a81f379e7c8e6e760: Generated new TSK 0
I20260811 07:02:50.902339 4729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:02:50.925472 4720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:50.916926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59992 (local address 127.30.73.126:46809)
0811 07:02:50.917180 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:50.917187 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:50.917529 (+ 342us) server_negotiation.cc:407] Connection header received
0811 07:02:50.917806 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:50.917810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:50.917960 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:50.918118 (+ 158us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:02:50.918707 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.919465 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.921567 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.922081 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.922212 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:50.922815 (+ 603us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:02:50.924790 (+ 1975us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41955/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 07:02:50.925121 (+ 331us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59992: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41955/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":99}
W20260811 07:02:50.925691 4749 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:02:50.916734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:46809 (local address 127.0.0.1:59992)
0811 07:02:50.917403 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:50.917424 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:50.917599 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:50.918162 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:50.918167 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:50.918182 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:02:50.918537 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:50.918550 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.919657 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.919663 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:50.921401 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:50.921416 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:50.922287 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:50.922294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:50.922499 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:50.922545 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:02:50.925008 (+ 2463us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41955/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 07:02:50.925251 (+ 243us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.73.126:46809: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41955/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":337,"threads_started":1}
W20260811 07:02:50.926023 4720 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59992: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41955/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260811 07:02:50.926874 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 4639
I20260811 07:02:50.928320 4710 generic_service.cc:196] Checking for leaks (request via RPC)
E20260811 07:02:50.938422 4751 webserver.cc:533] Webserver: sslize failed:
E20260811 07:02:50.938526 4751 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 07:02:51.019943 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 4639
2026-08-11T07:02:51Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (763 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T07:02:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:51Z Disabled control of system clock
I20260811 07:02:51.113734 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44661
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:35585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44661
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/testchainca.cert with env {}
W20260811 07:02:51.449594 4758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:51.449986 4758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:51.450142 4758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:51.457507 4758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:51.457609 4758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:51.457711 4758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:51.457799 4758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:51.457904 4758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:02:51.458021 4758 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:02:51.458117 4758 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 07:02:51.468678 4758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:35585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44661
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:51.470134 4758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:51.471565 4758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:51.483881 4768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:51.483994 4765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:51.483981 4766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:51.484871 4758 server_base.cc:1034] running on GCE node
I20260811 07:02:51.485697 4758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:51.487164 4758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:51.488407 4758 hybrid_clock.cc:648] HybridClock initialized: now 1786431771488362 us; error 34 us; skew 500 ppm
I20260811 07:02:51.488770 4758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:02:51.496413 4758 webserver.cc:460] Webserver started at http://127.30.73.126:44121/ using document root <none> and password file <none>
I20260811 07:02:51.497157 4758 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:51.497306 4758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:51.497637 4758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:51.500686 4758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "f0fa8d04e0984dc392f3043a73dc16fd"
format_stamp: "Formatted at 2026-08-11 07:02:51 on dist-test-slave-69rg"
server_key: "39ae87b2a7978f4277fc56108e7b3e08"
server_key_iv: "2bed0dcf256011eff6e460b27ae8b03e"
server_key_version: "encryptionkey@0"
I20260811 07:02:51.501520 4758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "f0fa8d04e0984dc392f3043a73dc16fd"
format_stamp: "Formatted at 2026-08-11 07:02:51 on dist-test-slave-69rg"
server_key: "39ae87b2a7978f4277fc56108e7b3e08"
server_key_iv: "2bed0dcf256011eff6e460b27ae8b03e"
server_key_version: "encryptionkey@0"
I20260811 07:02:51.506814 4758 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.002s
I20260811 07:02:51.510464 4774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:51.511956 4758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:02:51.512166 4758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "f0fa8d04e0984dc392f3043a73dc16fd"
format_stamp: "Formatted at 2026-08-11 07:02:51 on dist-test-slave-69rg"
server_key: "39ae87b2a7978f4277fc56108e7b3e08"
server_key_iv: "2bed0dcf256011eff6e460b27ae8b03e"
server_key_version: "encryptionkey@0"
I20260811 07:02:51.512421 4758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:51.542276 4758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:51.543187 4758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:51.543493 4758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:51.562769 4758 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:44661
I20260811 07:02:51.562789 4832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:44661 every 8 connection(s)
I20260811 07:02:51.564143 4758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:51.566166 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 4758
I20260811 07:02:51.566391 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:51.567049 31013 external_mini_cluster.cc:1428] Setting key 1384ad988dbda5685dd67c3aa4511422
I20260811 07:02:51.568282 4833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:51.582271 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:51.568981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51398 (local address 127.30.73.126:44661)
0811 07:02:51.570076 (+ 1095us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:51.570090 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:51.570143 (+ 53us) server_negotiation.cc:407] Connection header received
0811 07:02:51.571888 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:51.571915 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:51.572509 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:51.572943 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:51.573475 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:51.575625 (+ 2150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:51.576864 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:51.577905 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:51.578094 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:51.579251 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:51.579261 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:51.579280 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:02:51.580042 (+ 762us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:51.580139 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:02:51.580195 (+ 56us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:51.580308 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:51.580554 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 07:02:51.580924 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":337,"threads_started":1}
I20260811 07:02:51.583449 4833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd: Bootstrap starting.
I20260811 07:02:51.586103 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:02:51.586910 4833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:51.588166 4833 log.cc:824] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd: Log is configured to *not* fsync() on all Append() calls
I20260811 07:02:51.591627 4833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd: No bootstrap required, opened a new log
I20260811 07:02:51.599325 4833 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fa8d04e0984dc392f3043a73dc16fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44661 } }
I20260811 07:02:51.599787 4833 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:51.599911 4833 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0fa8d04e0984dc392f3043a73dc16fd, State: Initialized, Role: FOLLOWER
I20260811 07:02:51.600492 4833 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fa8d04e0984dc392f3043a73dc16fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44661 } }
I20260811 07:02:51.600744 4833 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:51.600922 4833 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:51.601112 4833 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:51.603426 4833 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fa8d04e0984dc392f3043a73dc16fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44661 } }
I20260811 07:02:51.603996 4833 leader_election.cc:302] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0fa8d04e0984dc392f3043a73dc16fd; no voters:
I20260811 07:02:51.604640 4833 leader_election.cc:288] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:51.604851 4838 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:51.605614 4838 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [term 1 LEADER]: Becoming Leader. State: Replica: f0fa8d04e0984dc392f3043a73dc16fd, State: Running, Role: LEADER
I20260811 07:02:51.606297 4838 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fa8d04e0984dc392f3043a73dc16fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44661 } }
I20260811 07:02:51.606933 4833 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:51.609284 4840 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0fa8d04e0984dc392f3043a73dc16fd. Latest consensus state: current_term: 1 leader_uuid: "f0fa8d04e0984dc392f3043a73dc16fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fa8d04e0984dc392f3043a73dc16fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44661 } } }
I20260811 07:02:51.609681 4840 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:51.609978 4839 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0fa8d04e0984dc392f3043a73dc16fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fa8d04e0984dc392f3043a73dc16fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44661 } } }
I20260811 07:02:51.610352 4839 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:51.614384 4847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:51.619956 4847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:51.628925 4847 catalog_manager.cc:1347] Generated new cluster ID: 35e9653c06454d1081c35da39562b147
I20260811 07:02:51.629065 4847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:51.645614 4847 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:51.647236 4847 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:51.658672 4847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0fa8d04e0984dc392f3043a73dc16fd: Generated new TSK 0
I20260811 07:02:51.659606 4847 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:02:52.931005 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:51.682934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51410 (local address 127.30.73.126:44661)
0811 07:02:51.683118 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:51.683125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:51.683511 (+ 386us) server_negotiation.cc:407] Connection header received
0811 07:02:51.683733 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:51.683739 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:51.683836 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:51.684004 (+ 168us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:02:51.684458 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:51.685601 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:51.687072 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:51.687777 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:51.687923 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:51.688375 (+ 452us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:02:52.930237 (+1241862us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 07:02:52.930719 (+ 482us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51410: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 07:02:52.931151 4836 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51410: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 07:02:52.931489 4865 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:02:51.682802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44661 (local address 127.0.0.1:51410)
0811 07:02:51.683408 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:51.683424 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:51.683545 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:51.684048 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:51.684051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:51.684062 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:02:51.684313 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:51.684321 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:51.685770 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:51.685775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:51.686923 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:51.686936 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:51.687944 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:51.687948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:51.688065 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:51.688096 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:02:52.930669 (+1242573us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 07:02:52.931000 (+ 331us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.73.126:44661: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":338,"threads_started":1}
I20260811 07:02:52.933568 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 4758
I20260811 07:02:52.935108 4827 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:53.053388 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 4758
2026-08-11T07:02:53Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (2021 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (489 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (453 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:54 dist-test-slave-69rg krb5kdc[4882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:54 dist-test-slave-69rg krb5kdc[4882](info): set up 2 sockets
Aug 11 07:02:54 dist-test-slave-69rg krb5kdc[4882](info): commencing operation
krb5kdc: starting...
W20260811 07:02:55.188354 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:55 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:02:55.435276 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36609
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:36609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:55.781941 4897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:55.782320 4897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:55.782505 4897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:55.790319 4897 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:02:55.790445 4897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:55.790540 4897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:55.790643 4897 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:02:55.790736 4897 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:02:55.801232 4897 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:36609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:55.802736 4897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:55.804116 4897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:55.817060 4903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:55.817024 4906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:55.817099 4904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:55.818342 4897 server_base.cc:1034] running on GCE node
I20260811 07:02:55.819201 4897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:55.820686 4897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:55.821918 4897 hybrid_clock.cc:648] HybridClock initialized: now 1786431775821855 us; error 55 us; skew 500 ppm
I20260811 07:02:55.822289 4897 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:55 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431775, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:55.825655 4897 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:02:55.827394 4897 webserver.cc:460] Webserver started at http://127.30.73.126:34117/ using document root <none> and password file <none>
I20260811 07:02:55.828118 4897 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:55.828274 4897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:55.828653 4897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:55.831851 4897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "1db2cff77694498488458cdf959ca408"
format_stamp: "Formatted at 2026-08-11 07:02:55 on dist-test-slave-69rg"
server_key: "4c992f94f3b791139d97904b138dabf2"
server_key_iv: "da9cacae8800245c7ac77e84f01803b9"
server_key_version: "encryptionkey@0"
I20260811 07:02:55.832671 4897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "1db2cff77694498488458cdf959ca408"
format_stamp: "Formatted at 2026-08-11 07:02:55 on dist-test-slave-69rg"
server_key: "4c992f94f3b791139d97904b138dabf2"
server_key_iv: "da9cacae8800245c7ac77e84f01803b9"
server_key_version: "encryptionkey@0"
I20260811 07:02:55.838220 4897 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 07:02:55.841949 4914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:55.843400 4897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:02:55.843592 4897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "1db2cff77694498488458cdf959ca408"
format_stamp: "Formatted at 2026-08-11 07:02:55 on dist-test-slave-69rg"
server_key: "4c992f94f3b791139d97904b138dabf2"
server_key_iv: "da9cacae8800245c7ac77e84f01803b9"
server_key_version: "encryptionkey@0"
I20260811 07:02:55.843818 4897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:55.874411 4897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:55.879734 4897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:55.880075 4897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:55.901437 4897 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:36609
I20260811 07:02:55.901479 4979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:36609 every 8 connection(s)
I20260811 07:02:55.902944 4897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:02:55.907579 4980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:02:55.910713 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 4897
I20260811 07:02:55.910943 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:02:55.911640 31013 external_mini_cluster.cc:1428] Setting key 66b305bed99dbb39b7bdba6139a781d8
I20260811 07:02:55.921734 4980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408: Bootstrap starting.
I20260811 07:02:55.925416 4980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408: Neither blocks nor log segments found. Creating new log.
I20260811 07:02:55.926523 4980 log.cc:824] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:02:55 dist-test-slave-69rg krb5kdc[4882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:55.929764 4980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408: No bootstrap required, opened a new log
I20260811 07:02:55.937727 4984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:55.914217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50974 (local address 127.30.73.126:36609)
0811 07:02:55.915070 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:55.915085 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:55.915139 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:02:55.917335 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:55.917366 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:55.917954 (+ 588us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:55.918404 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:55.919795 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:55.921793 (+ 1998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:55.923127 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:55.924201 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:55.924389 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:55.928845 (+ 4456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:55.928860 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:55.928882 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:55.928933 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:55.933078 (+ 4145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:55.933738 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:55.933747 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:55.933756 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:55.933999 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:55.934384 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:55.934389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:55.934392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:55.935095 (+ 703us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:55.935408 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:55.935837 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 07:02:55.936304 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":343,"threads_started":1}
I20260811 07:02:55.940788 4980 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1db2cff77694498488458cdf959ca408" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36609 } }
I20260811 07:02:55.941154 4980 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:02:55.941244 4980 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db2cff77694498488458cdf959ca408, State: Initialized, Role: FOLLOWER
I20260811 07:02:55.941792 4980 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1db2cff77694498488458cdf959ca408" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36609 } }
I20260811 07:02:55.942081 4980 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:02:55.942185 4980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:02:55.942305 4980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:02:55.944690 4980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1db2cff77694498488458cdf959ca408" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36609 } }
I20260811 07:02:55.945140 4980 leader_election.cc:302] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1db2cff77694498488458cdf959ca408; no voters:
I20260811 07:02:55.945696 4980 leader_election.cc:288] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:02:55.945868 4986 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:02:55.946619 4986 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [term 1 LEADER]: Becoming Leader. State: Replica: 1db2cff77694498488458cdf959ca408, State: Running, Role: LEADER
I20260811 07:02:55.947136 4986 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1db2cff77694498488458cdf959ca408" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36609 } }
I20260811 07:02:55.948099 4980 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:02:55.950116 4988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1db2cff77694498488458cdf959ca408. Latest consensus state: current_term: 1 leader_uuid: "1db2cff77694498488458cdf959ca408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1db2cff77694498488458cdf959ca408" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36609 } } }
I20260811 07:02:55.950605 4988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:55.951205 4987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1db2cff77694498488458cdf959ca408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1db2cff77694498488458cdf959ca408" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36609 } } }
I20260811 07:02:55.951520 4987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408 [sys.catalog]: This master's current role is: LEADER
I20260811 07:02:55.956413 4996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:02:55.961452 4996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:02:55.970738 4996 catalog_manager.cc:1347] Generated new cluster ID: 2cb99495945d42a2aabd51c83bdb100b
I20260811 07:02:55.970882 4996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:02:55.986568 4996 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:02:55.988082 4996 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:02:55.997032 4996 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1db2cff77694498488458cdf959ca408: Generated new TSK 0
I20260811 07:02:55.997993 4996 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:02:56.059607 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36609
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:56.412858 5009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:56.413224 5009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:56.413393 5009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:56.420990 5009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:56.421183 5009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:56.421397 5009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:02:56.431804 5009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:56.433308 5009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:56.434862 5009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:56.448904 5014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:56.448930 5017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:56.448863 5019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:56.449790 5009 server_base.cc:1034] running on GCE node
I20260811 07:02:56.450529 5009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:56.451913 5009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:56.453121 5009 hybrid_clock.cc:648] HybridClock initialized: now 1786431776453049 us; error 62 us; skew 500 ppm
I20260811 07:02:56.453514 5009 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:56 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431776, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:56.457640 5009 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:02:56.459350 5009 webserver.cc:460] Webserver started at http://127.30.73.65:45297/ using document root <none> and password file <none>
I20260811 07:02:56.460104 5009 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:56.460273 5009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:56.460623 5009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:56.463871 5009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "246ec00ad5e640c9b564b91243e4ea0d"
format_stamp: "Formatted at 2026-08-11 07:02:56 on dist-test-slave-69rg"
server_key: "057751b2e45ba4ac8f7bf3f58cc2daf0"
server_key_iv: "a8fcff6f6bead4b22e279226c696dd3f"
server_key_version: "encryptionkey@0"
I20260811 07:02:56.465409 5009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "246ec00ad5e640c9b564b91243e4ea0d"
format_stamp: "Formatted at 2026-08-11 07:02:56 on dist-test-slave-69rg"
server_key: "057751b2e45ba4ac8f7bf3f58cc2daf0"
server_key_iv: "a8fcff6f6bead4b22e279226c696dd3f"
server_key_version: "encryptionkey@0"
I20260811 07:02:56.472259 5009 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:02:56.476356 5026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:56.477995 5009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:02:56.478262 5009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "246ec00ad5e640c9b564b91243e4ea0d"
format_stamp: "Formatted at 2026-08-11 07:02:56 on dist-test-slave-69rg"
server_key: "057751b2e45ba4ac8f7bf3f58cc2daf0"
server_key_iv: "a8fcff6f6bead4b22e279226c696dd3f"
server_key_version: "encryptionkey@0"
I20260811 07:02:56.478523 5009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:56.492128 5009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:56.500792 5009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:56.501142 5009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:56.502329 5009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:56.503973 5009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:56.504091 5009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:56.504251 5009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:56.504328 5009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:56.543828 5009 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:35143
I20260811 07:02:56.543843 5154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:35143 every 8 connection(s)
I20260811 07:02:56.545221 5009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:02:56.547241 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 5009
I20260811 07:02:56.547505 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:02:56.548478 31013 external_mini_cluster.cc:1428] Setting key 2f5d7b98ce718e86a551d9dfa6e8f0da
Aug 11 07:02:56 dist-test-slave-69rg krb5kdc[4882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431776, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:56.568899 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:56.548151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:56243 (local address 127.30.73.126:36609)
0811 07:02:56.548780 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:56.548785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:56.550007 (+ 1222us) server_negotiation.cc:407] Connection header received
0811 07:02:56.551913 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:56.551919 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:56.552009 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:56.552144 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:56.554302 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:56.555049 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:56.556755 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:56.557192 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:56.557340 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:56.561901 (+ 4561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:56.561916 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:56.561921 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:56.561960 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:56.564681 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:56.565813 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:56.565895 (+ 82us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:56.565898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:56.566050 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:56.566794 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:56.566799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:56.566801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:56.567127 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:56.567294 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:56.568386 (+ 1092us) server_negotiation.cc:299] Negotiation successful
0811 07:02:56.568606 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":353,"threads_started":1}
I20260811 07:02:56.570538 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:56.548866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36609 (local address 127.30.73.65:56243)
0811 07:02:56.549804 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:56.549892 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:56.551620 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:56.552403 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:56.552412 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:56.553259 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:56.554096 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:56.554119 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:56.555230 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:56.555234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:56.556591 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:56.556604 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:56.557449 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:56.557457 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:56.557699 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:56.558522 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:56.558546 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:56.561546 (+ 3000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:56.564859 (+ 3313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:56.564871 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:56.564895 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:56.565635 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:56.566292 (+ 657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:56.566301 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:56.566308 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:56.566636 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:56.567311 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:56.567323 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:56.567901 (+ 578us) client_negotiation.cc:769] Sending connection context
0811 07:02:56.568247 (+ 346us) client_negotiation.cc:240] Negotiation successful
0811 07:02:56.568874 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":414,"threads_started":1}
I20260811 07:02:56.572319 5155 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36609
I20260811 07:02:56.572710 5155 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:56.573717 5155 heartbeater.cc:511] Master 127.30.73.126:36609 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
I20260811 07:02:56.576433 4937 ts_manager.cc:194] Registered new tserver with Master: 246ec00ad5e640c9b564b91243e4ea0d (127.30.73.65:35143)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
I20260811 07:02:56.578231 4937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:56243
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:02:56.611225 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36609
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:56.995086 5161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:56.995414 5161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:56.995581 5161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:57.004112 5161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:57.004273 5161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:57.004480 5161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:02:57.016151 5161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:57.017727 5161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:57.019176 5161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:57.033481 5166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:57.033550 5169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:57.033576 5167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:57.034792 5161 server_base.cc:1034] running on GCE node
I20260811 07:02:57.035481 5161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:57.036501 5161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:57.037743 5161 hybrid_clock.cc:648] HybridClock initialized: now 1786431777037637 us; error 72 us; skew 500 ppm
I20260811 07:02:57.038152 5161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:57.041615 5161 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:02:57.043511 5161 webserver.cc:460] Webserver started at http://127.30.73.66:33285/ using document root <none> and password file <none>
I20260811 07:02:57.044274 5161 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:57.044431 5161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:57.044802 5161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:57.048329 5161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "85ba445e25f04d588d0ba6e7223beb3d"
format_stamp: "Formatted at 2026-08-11 07:02:57 on dist-test-slave-69rg"
server_key: "b9abc73c7168485da0a3bc4a4e653a7f"
server_key_iv: "45d605918b56b12b1d41e892e2e35001"
server_key_version: "encryptionkey@0"
I20260811 07:02:57.049347 5161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "85ba445e25f04d588d0ba6e7223beb3d"
format_stamp: "Formatted at 2026-08-11 07:02:57 on dist-test-slave-69rg"
server_key: "b9abc73c7168485da0a3bc4a4e653a7f"
server_key_iv: "45d605918b56b12b1d41e892e2e35001"
server_key_version: "encryptionkey@0"
I20260811 07:02:57.055435 5161 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 07:02:57.059633 5176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:57.061450 5161 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:02:57.061697 5161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "85ba445e25f04d588d0ba6e7223beb3d"
format_stamp: "Formatted at 2026-08-11 07:02:57 on dist-test-slave-69rg"
server_key: "b9abc73c7168485da0a3bc4a4e653a7f"
server_key_iv: "45d605918b56b12b1d41e892e2e35001"
server_key_version: "encryptionkey@0"
I20260811 07:02:57.062049 5161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:57.080519 5161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:57.086654 5161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:57.087023 5161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:57.088135 5161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:57.089655 5161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:57.089774 5161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:57.089967 5161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:57.090049 5161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:57.127540 5161 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:37751
I20260811 07:02:57.127592 5300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:37751 every 8 connection(s)
I20260811 07:02:57.128973 5161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:02:57.129539 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 5161
I20260811 07:02:57.129745 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:02:57.130406 31013 external_mini_cluster.cc:1428] Setting key 9381ed165b4262778a899660644f1055
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:57.156683 5303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:57.131952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:37599 (local address 127.30.73.126:36609)
0811 07:02:57.132456 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.132463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.133677 (+ 1214us) server_negotiation.cc:407] Connection header received
0811 07:02:57.136765 (+ 3088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.136770 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.136841 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.136946 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.139333 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.140137 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.143166 (+ 3029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.143679 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.143851 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:57.148495 (+ 4644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:57.148505 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:57.148513 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:57.148567 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:57.152678 (+ 4111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.153631 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.153639 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.153646 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.153860 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.154547 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.154551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.154554 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.154892 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:57.155140 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:57.156002 (+ 862us) server_negotiation.cc:299] Negotiation successful
0811 07:02:57.156263 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":251,"threads_started":1}
I20260811 07:02:57.157998 5304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:57.132605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36609 (local address 127.30.73.66:37599)
0811 07:02:57.133486 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:57.133537 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:57.136408 (+ 2871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:57.137261 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:57.137277 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:57.138206 (+ 929us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:57.139097 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:57.139127 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.140349 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.140359 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:57.142941 (+ 2582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:57.142964 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.143970 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.143979 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:57.144282 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:57.145107 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:57.145137 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:57.148066 (+ 2929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:57.152890 (+ 4824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:57.152900 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:57.152916 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:57.153460 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:57.154006 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:57.154012 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:57.154015 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:57.154356 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:57.155126 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:57.155135 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:57.155599 (+ 464us) client_negotiation.cc:769] Sending connection context
0811 07:02:57.155895 (+ 296us) client_negotiation.cc:240] Negotiation successful
0811 07:02:57.156533 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":326,"threads_started":1}
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
I20260811 07:02:57.159889 5301 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36609
I20260811 07:02:57.160233 5301 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:57.161141 5301 heartbeater.cc:511] Master 127.30.73.126:36609 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
I20260811 07:02:57.163296 4937 ts_manager.cc:194] Registered new tserver with Master: 85ba445e25f04d588d0ba6e7223beb3d (127.30.73.66:37751)
I20260811 07:02:57.164676 4937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:37599
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:02:57.198295 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36609
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:02:57.564400 5307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:02:57.564770 5307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:02:57.564955 5307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:02:57.572904 5307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:02:57.573100 5307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:02:57.573297 5307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:02:57.581698 5155 heartbeater.cc:503] Master 127.30.73.126:36609 was elected leader, sending a full tablet report...
I20260811 07:02:57.584164 5307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:02:57.585624 5307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:02:57.587085 5307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:02:57.601097 5312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:57.601060 5314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:02:57.601128 5316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:02:57.601965 5307 server_base.cc:1034] running on GCE node
I20260811 07:02:57.602633 5307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:02:57.603667 5307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:02:57.604916 5307 hybrid_clock.cc:648] HybridClock initialized: now 1786431777604852 us; error 59 us; skew 500 ppm
I20260811 07:02:57.605276 5307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:57.608599 5307 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:02:57.610450 5307 webserver.cc:460] Webserver started at http://127.30.73.67:45371/ using document root <none> and password file <none>
I20260811 07:02:57.611179 5307 fs_manager.cc:359] Metadata directory not provided
I20260811 07:02:57.611334 5307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:02:57.611666 5307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:02:57.614835 5307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "094360130b984c989fed61602401a073"
format_stamp: "Formatted at 2026-08-11 07:02:57 on dist-test-slave-69rg"
server_key: "59b48ea82ee74dec44fb8bd61117a758"
server_key_iv: "1c92b43c50e281d570f5484122c70d03"
server_key_version: "encryptionkey@0"
I20260811 07:02:57.615818 5307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "094360130b984c989fed61602401a073"
format_stamp: "Formatted at 2026-08-11 07:02:57 on dist-test-slave-69rg"
server_key: "59b48ea82ee74dec44fb8bd61117a758"
server_key_iv: "1c92b43c50e281d570f5484122c70d03"
server_key_version: "encryptionkey@0"
I20260811 07:02:57.622110 5307 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:02:57.626241 5323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:57.627748 5307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:02:57.627985 5307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "094360130b984c989fed61602401a073"
format_stamp: "Formatted at 2026-08-11 07:02:57 on dist-test-slave-69rg"
server_key: "59b48ea82ee74dec44fb8bd61117a758"
server_key_iv: "1c92b43c50e281d570f5484122c70d03"
server_key_version: "encryptionkey@0"
I20260811 07:02:57.628275 5307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:02:57.655759 5307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:02:57.660764 5307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:02:57.661149 5307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:02:57.662272 5307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:02:57.663882 5307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:02:57.663961 5307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:57.664050 5307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:02:57.664098 5307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:02:57.700317 5307 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:40793
I20260811 07:02:57.700433 5449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:40793 every 8 connection(s)
I20260811 07:02:57.701712 5307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:02:57.707408 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 5307
I20260811 07:02:57.707641 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:02:57.708127 31013 external_mini_cluster.cc:1428] Setting key 739ea48204cd67c66ed1a1fc3b3d8d72
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:02:57.724613 5452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:57.704842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:42773 (local address 127.30.73.126:36609)
0811 07:02:57.705549 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.705554 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.706397 (+ 843us) server_negotiation.cc:407] Connection header received
0811 07:02:57.708555 (+ 2158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.708561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.708677 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.708803 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.710835 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.711951 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.713595 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.714069 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.714175 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:57.718136 (+ 3961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:57.718142 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:57.718145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:57.718182 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:57.720782 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.721582 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.721587 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.721589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.721713 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.722330 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.722334 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.722336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.722714 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:57.722855 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:57.723919 (+ 1064us) server_negotiation.cc:299] Negotiation successful
0811 07:02:57.724163 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":450,"threads_started":1}
I20260811 07:02:57.725713 5453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:57.705281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36609 (local address 127.30.73.67:42773)
0811 07:02:57.706179 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0811 07:02:57.706252 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 07:02:57.708171 (+ 1919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:02:57.709137 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:02:57.709146 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:02:57.709911 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:02:57.710649 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:57.710670 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.712138 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.712142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:57.713451 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:02:57.713466 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.714335 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.714342 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:02:57.714584 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:57.715342 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:02:57.715367 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:02:57.717886 (+ 2519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:02:57.720939 (+ 3053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:57.720947 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:57.720962 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:57.721455 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:57.721895 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:02:57.721899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:02:57.721902 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:02:57.722200 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:02:57.722900 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:02:57.722909 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:02:57.723474 (+ 565us) client_negotiation.cc:769] Sending connection context
0811 07:02:57.723762 (+ 288us) client_negotiation.cc:240] Negotiation successful
0811 07:02:57.724370 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":375,"threads_started":1}
I20260811 07:02:57.727535 5450 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36609
I20260811 07:02:57.727887 5450 heartbeater.cc:464] Registering TS with master...
I20260811 07:02:57.728703 5450 heartbeater.cc:511] Master 127.30.73.126:36609 requested a full tablet report, sending...
I20260811 07:02:57.730451 4937 ts_manager.cc:194] Registered new tserver with Master: 094360130b984c989fed61602401a073 (127.30.73.67:40793)
I20260811 07:02:57.731395 4937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:42773
I20260811 07:02:57.737444 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/test-admin.keytab.
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:57.773780 31013 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 07:02:57.779945 5458 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:02:57.777131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39626 (local address 127.30.73.65:35143)
0811 07:02:57.777914 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.777922 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.777952 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:02:57.778018 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.778026 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.778273 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.778452 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.779509 (+ 1057us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39626: BlockingRecv error: recv got EOF from 127.0.0.1:39626 (error 108)
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":397,"threads_started":1}
W20260811 07:02:57.779937 31013 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:57.781972 31013 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:57.783824 31013 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:57.801992 5458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:57.785796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39630 (local address 127.30.73.65:35143)
0811 07:02:57.786058 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.786065 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.786206 (+ 141us) server_negotiation.cc:407] Connection header received
0811 07:02:57.786376 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.786380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.786444 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.786527 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.787675 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.788754 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.790124 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.790790 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.790904 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:57.795632 (+ 4728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:57.795659 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:57.795682 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:57.795728 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:57.799142 (+ 3414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.799971 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.799978 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.799981 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.800111 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.800455 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.800459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.800461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.800843 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:57.801070 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:57.801430 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 07:02:57.801647 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
W20260811 07:02:57.808679 5458 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:02:57.806553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39634 (local address 127.30.73.65:35143)
0811 07:02:57.806835 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.806842 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.807114 (+ 272us) server_negotiation.cc:407] Connection header received
0811 07:02:57.807322 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.807328 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.807419 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.807532 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.808375 (+ 843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39634: BlockingRecv error: recv got EOF from 127.0.0.1:39634 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
W20260811 07:02:57.809020 31013 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:57.810765 31013 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:57.812381 31013 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:57.828903 5458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:57.814275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39648 (local address 127.30.73.65:35143)
0811 07:02:57.814597 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.814604 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.814876 (+ 272us) server_negotiation.cc:407] Connection header received
0811 07:02:57.815063 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.815069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.815144 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.815273 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.816368 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.817180 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.818576 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.819088 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.819216 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:57.823241 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:57.823247 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:57.823250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:57.823292 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:57.826184 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.826945 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.826950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.826953 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.827154 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.827581 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.827588 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.827591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.827916 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:57.828152 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:57.828383 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 07:02:57.828568 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 07:02:57.834496 5458 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:02:57.832363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39658 (local address 127.30.73.65:35143)
0811 07:02:57.832577 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.832584 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.832805 (+ 221us) server_negotiation.cc:407] Connection header received
0811 07:02:57.832994 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.833000 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.833089 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.833229 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.834239 (+ 1010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39658: BlockingRecv error: recv got EOF from 127.0.0.1:39658 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 07:02:57.834955 31013 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786431722204153-31013-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:57.836897 31013 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:02:57.838359 31013 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:02:57.857120 5458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:57.840079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39672 (local address 127.30.73.65:35143)
0811 07:02:57.840598 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.840610 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.840642 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:02:57.840964 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.840970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.841055 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.841232 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.842516 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.843347 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.845131 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.845671 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.845791 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:57.850950 (+ 5159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:57.850956 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:57.850959 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:57.851008 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:57.853971 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.854883 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.854888 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.854890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.855124 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.855474 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.855478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.855480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.855788 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:57.856221 (+ 433us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:57.856512 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 07:02:57.856758 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223}
I20260811 07:02:57.860157 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 5009
I20260811 07:02:57.875068 5458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:57.861245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39676 (local address 127.30.73.65:35143)
0811 07:02:57.861991 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.861996 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.862035 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:02:57.862525 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.862535 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.862637 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.862790 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.863930 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.864675 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.866075 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.866538 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.866641 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:57.869080 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:57.869085 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:57.869088 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:57.869124 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:57.872124 (+ 3000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.872893 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.872898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.872900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.873053 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:57.873592 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:57.873596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:57.873598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:57.873998 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:57.874219 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:57.874599 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 07:02:57.874794 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241}
I20260811 07:02:57.875801 5150 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:57.963634 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 5009
I20260811 07:02:57.985399 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 5161
Aug 11 07:02:57 dist-test-slave-69rg krb5kdc[4882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:02:58.003084 5471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:57.986407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47588 (local address 127.30.73.66:37751)
0811 07:02:57.986980 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:57.986988 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:57.987016 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:02:57.987081 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:57.987094 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:57.987310 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:57.987450 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:57.988464 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.989562 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.991050 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:57.991673 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:57.991802 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:57.996759 (+ 4957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:57.996776 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:57.996794 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:57.996835 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:57.999940 (+ 3105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:58.000736 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:58.000745 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:58.000747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:58.000878 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:58.001329 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:58.001334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:58.001336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:58.001729 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:58.002058 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:58.002437 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 07:02:58.002778 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":292,"threads_started":1}
I20260811 07:02:58.004410 5296 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:58.094290 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 5161
I20260811 07:02:58.117379 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 5307
Aug 11 07:02:58 dist-test-slave-69rg krb5kdc[4882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:02:58.135084 5475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:02:58.118435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40652 (local address 127.30.73.67:40793)
0811 07:02:58.119076 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0811 07:02:58.119084 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:02:58.119112 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:02:58.119175 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:02:58.119184 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:02:58.119410 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:02:58.119604 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:02:58.120744 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:58.122201 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:58.123515 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:02:58.124109 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:02:58.124272 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:02:58.128561 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:02:58.128574 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:02:58.128591 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:02:58.128637 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:02:58.131972 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:58.132767 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:58.132775 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:58.132778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:58.132921 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:02:58.133446 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:02:58.133449 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:02:58.133451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:02:58.133894 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:02:58.134140 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 07:02:58.134453 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 07:02:58.134730 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":317,"threads_started":1}
I20260811 07:02:58.136526 5445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:58.221203 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 5307
I20260811 07:02:58.243849 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 4897
I20260811 07:02:58.245157 4974 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:02:58.350992 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 4897
2026-08-11T07:02:58Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4352 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:02:58 dist-test-slave-69rg krb5kdc[5480](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:02:58 dist-test-slave-69rg krb5kdc[5480](info): set up 2 sockets
Aug 11 07:02:58 dist-test-slave-69rg krb5kdc[5480](info): commencing operation
krb5kdc: starting...
W20260811 07:02:59.554260 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:02:59 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:02:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:02:59Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.126.keytab.
Entry for principal oryx/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.126.keytab.
I20260811 07:02:59.818403 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44089
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.126.keytab
--principal=oryx/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44089
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:00.164281 5495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:00.164573 5495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:00.164767 5495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:00.172281 5495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:00.172395 5495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:00.172494 5495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:00.172598 5495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:00.172667 5495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:00.182783 5495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.126.keytab
--principal=oryx/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:00.184154 5495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:00.185572 5495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:00.197566 5502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:00.197660 5503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:00.197727 5506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:00.199000 5495 server_base.cc:1034] running on GCE node
I20260811 07:03:00.199834 5495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:00.201269 5495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:00.202500 5495 hybrid_clock.cc:648] HybridClock initialized: now 1786431780202470 us; error 47 us; skew 500 ppm
I20260811 07:03:00.202878 5495 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:00 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431780, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:00.206040 5495 init.cc:377] Logged in from keytab as oryx/127.30.73.126@KRBTEST.COM (short username oryx)
I20260811 07:03:00.207625 5495 webserver.cc:460] Webserver started at http://127.30.73.126:33799/ using document root <none> and password file <none>
I20260811 07:03:00.208328 5495 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:00.208482 5495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:00.208797 5495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:00.211910 5495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "921f08041d074ff5ad589360142f632c"
format_stamp: "Formatted at 2026-08-11 07:03:00 on dist-test-slave-69rg"
server_key: "7a6c0048380bc18bb69fc4ce9b3e292c"
server_key_iv: "8f5e6c7bd5aa9baae3a66bb51a0351ad"
server_key_version: "encryptionkey@0"
I20260811 07:03:00.212685 5495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "921f08041d074ff5ad589360142f632c"
format_stamp: "Formatted at 2026-08-11 07:03:00 on dist-test-slave-69rg"
server_key: "7a6c0048380bc18bb69fc4ce9b3e292c"
server_key_iv: "8f5e6c7bd5aa9baae3a66bb51a0351ad"
server_key_version: "encryptionkey@0"
I20260811 07:03:00.217777 5495 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:03:00.221320 5513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:00.222903 5495 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:00.223119 5495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "921f08041d074ff5ad589360142f632c"
format_stamp: "Formatted at 2026-08-11 07:03:00 on dist-test-slave-69rg"
server_key: "7a6c0048380bc18bb69fc4ce9b3e292c"
server_key_iv: "8f5e6c7bd5aa9baae3a66bb51a0351ad"
server_key_version: "encryptionkey@0"
I20260811 07:03:00.223348 5495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:00.240543 5495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:00.244613 5495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:00.244906 5495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:00.264552 5570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:44089 every 8 connection(s)
I20260811 07:03:00.264549 5495 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:44089
I20260811 07:03:00.266538 5495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:03:00.270646 5571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:00.274231 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 5495
I20260811 07:03:00.274456 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:03:00.275120 31013 external_mini_cluster.cc:1428] Setting key 50462a621221eba19cb5eee4b1140306
I20260811 07:03:00.283278 5571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: Bootstrap starting.
I20260811 07:03:00.286351 5571 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:00.287369 5571 log.cc:824] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:03:00 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:00.290283 5571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: No bootstrap required, opened a new log
I20260811 07:03:00.297740 5575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:00.277201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40288 (local address 127.30.73.126:44089)
0811 07:03:00.278165 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:00.278177 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:00.278218 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:03:00.279806 (+ 1588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:00.279828 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:00.280327 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:00.280792 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:00.282341 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:00.283717 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:00.284977 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:00.285627 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:00.285827 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:00.289913 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:00.289922 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:00.289936 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:00.289973 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:00.293400 (+ 3427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:00.294240 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:00.294248 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:00.294254 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:00.294432 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:00.294858 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:00.294862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:00.294864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:00.295430 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:00.295782 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:00.296264 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 07:03:00.296696 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":734,"thread_start_us":364,"threads_started":1}
I20260811 07:03:00.298817 5571 raft_consensus.cc:348] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } }
I20260811 07:03:00.299376 5571 raft_consensus.cc:374] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:00.299497 5571 raft_consensus.cc:729] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 921f08041d074ff5ad589360142f632c, State: Initialized, Role: FOLLOWER
I20260811 07:03:00.300092 5571 consensus_queue.cc:260] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } }
I20260811 07:03:00.300316 5571 raft_consensus.cc:388] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:03:00.300418 5571 raft_consensus.cc:482] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:03:00.300557 5571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:00.303257 5571 raft_consensus.cc:504] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } }
I20260811 07:03:00.303772 5571 leader_election.cc:302] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 921f08041d074ff5ad589360142f632c; no voters:
I20260811 07:03:00.304464 5571 leader_election.cc:288] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:03:00.304610 5577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:00.305330 5577 raft_consensus.cc:686] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 1 LEADER]: Becoming Leader. State: Replica: 921f08041d074ff5ad589360142f632c, State: Running, Role: LEADER
I20260811 07:03:00.305914 5577 consensus_queue.cc:237] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } }
I20260811 07:03:00.306963 5571 sys_catalog.cc:564] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:03:00.309160 5579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } }
I20260811 07:03:00.309528 5579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:00.311751 5581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 921f08041d074ff5ad589360142f632c. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } }
I20260811 07:03:00.312060 5581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:00.312750 5586 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:03:00.318497 5586 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:03:00.327818 5586 catalog_manager.cc:1347] Generated new cluster ID: 5fcc663ca6cb488da94262d01760ee58
I20260811 07:03:00.327939 5586 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:03:00.348762 5586 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:03:00.350226 5586 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:03:00.359894 5586 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: Generated new TSK 0
I20260811 07:03:00.360836 5586 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab.
Entry for principal oryx/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab.
I20260811 07:03:00.438519 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44089
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab
--principal=oryx/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:00.795590 5603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:00.795905 5603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:00.796005 5603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:00.803875 5603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:00.804006 5603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:00.804122 5603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:03:00.814929 5603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab
--principal=oryx/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44089
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:00.816293 5603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:00.817577 5603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:00.833177 5610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:00.833216 5612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:00.833061 5609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:00.834851 5603 server_base.cc:1034] running on GCE node
I20260811 07:03:00.835918 5603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:00.837474 5603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:00.838862 5603 hybrid_clock.cc:648] HybridClock initialized: now 1786431780838750 us; error 58 us; skew 500 ppm
I20260811 07:03:00.839672 5603 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:00 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431780, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:00.844082 5603 init.cc:377] Logged in from keytab as oryx/127.30.73.65@KRBTEST.COM (short username oryx)
I20260811 07:03:00.846028 5603 webserver.cc:460] Webserver started at http://127.30.73.65:43605/ using document root <none> and password file <none>
I20260811 07:03:00.846869 5603 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:00.847035 5603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:00.847385 5603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:00.851313 5603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "6005d096eb434aaf9971fd63efd0bd14"
format_stamp: "Formatted at 2026-08-11 07:03:00 on dist-test-slave-69rg"
server_key: "43fe9699a7dfdee455ef31546309b17f"
server_key_iv: "11d22fda38ed622917e16f6f29dd1582"
server_key_version: "encryptionkey@0"
I20260811 07:03:00.852237 5603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "6005d096eb434aaf9971fd63efd0bd14"
format_stamp: "Formatted at 2026-08-11 07:03:00 on dist-test-slave-69rg"
server_key: "43fe9699a7dfdee455ef31546309b17f"
server_key_iv: "11d22fda38ed622917e16f6f29dd1582"
server_key_version: "encryptionkey@0"
I20260811 07:03:00.860720 5603 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.008s
I20260811 07:03:00.865093 5619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:00.866850 5603 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:00.867074 5603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "6005d096eb434aaf9971fd63efd0bd14"
format_stamp: "Formatted at 2026-08-11 07:03:00 on dist-test-slave-69rg"
server_key: "43fe9699a7dfdee455ef31546309b17f"
server_key_iv: "11d22fda38ed622917e16f6f29dd1582"
server_key_version: "encryptionkey@0"
I20260811 07:03:00.867329 5603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:00.895869 5603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:00.900657 5603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:00.900990 5603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:00.902504 5603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:00.904508 5603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:00.904590 5603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:00.904683 5603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:00.904733 5603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:00.946699 5603 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:34877
I20260811 07:03:00.946851 5753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:34877 every 8 connection(s)
I20260811 07:03:00.948160 5603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:03:00.949318 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 5603
I20260811 07:03:00.949548 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:03:00.950829 31013 external_mini_cluster.cc:1428] Setting key 69d4bcb38df5f4ce7fc51b7e49239b55
Aug 11 07:03:00 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431780, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:00.978672 5756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:00.951820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:41831 (local address 127.30.73.126:44089)
0811 07:03:00.952336 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:00.952341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:00.953841 (+ 1500us) server_negotiation.cc:407] Connection header received
0811 07:03:00.956962 (+ 3121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:00.956967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:00.957047 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:00.957150 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:00.959762 (+ 2612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:00.960782 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:00.963746 (+ 2964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:00.964249 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:00.964445 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:00.969518 (+ 5073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:00.969528 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:00.969536 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:00.969593 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:00.974206 (+ 4613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:00.975358 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:00.975368 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:00.975374 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:00.975548 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:00.976056 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:00.976064 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:00.976070 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:00.976548 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:00.976727 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:00.977783 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0811 07:03:00.978157 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":278,"threads_started":1}
I20260811 07:03:00.979367 5757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:00.952503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.65:41831)
0811 07:03:00.953621 (+ 1118us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:00.953679 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:00.956600 (+ 2921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:00.957480 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:00.957495 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:00.958411 (+ 916us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:00.959320 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:00.959351 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:00.961055 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:00.961064 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:00.963414 (+ 2350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:00.963445 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:00.964534 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:00.964540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:00.964763 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:00.965728 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:00.965772 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:00.969174 (+ 3402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:00.974528 (+ 5354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:00.974539 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:00.974557 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:00.975177 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:00.975690 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:00.975694 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:00.975696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:00.975907 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:00.976778 (+ 871us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:00.976786 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:00.977291 (+ 505us) client_negotiation.cc:769] Sending connection context
0811 07:03:00.977579 (+ 288us) client_negotiation.cc:240] Negotiation successful
0811 07:03:00.978146 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"thread_start_us":549,"threads_started":1}
I20260811 07:03:00.981236 5754 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44089
I20260811 07:03:00.981617 5754 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for oryx/127.30.73.66@KRBTEST.COM; defaulting to no policy
I20260811 07:03:00.982501 5754 heartbeater.cc:511] Master 127.30.73.126:44089 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.66@KRBTEST.COM" created.
I20260811 07:03:00.985282 5533 ts_manager.cc:194] Registered new tserver with Master: 6005d096eb434aaf9971fd63efd0bd14 (127.30.73.65:34877)
I20260811 07:03:00.987622 5533 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:41831
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab.
Entry for principal oryx/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab.
I20260811 07:03:01.033792 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44089
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab
--principal=oryx/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:01.413524 5760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:01.413867 5760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:01.414043 5760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:01.421317 5760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:01.421479 5760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:01.421670 5760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:03:01.431707 5760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab
--principal=oryx/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44089
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:01.433027 5760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:01.434365 5760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:01.447602 5766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:01.447548 5770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:01.447513 5767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:01.448341 5760 server_base.cc:1034] running on GCE node
I20260811 07:03:01.449028 5760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:01.450098 5760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:01.451376 5760 hybrid_clock.cc:648] HybridClock initialized: now 1786431781451327 us; error 32 us; skew 500 ppm
I20260811 07:03:01.451774 5760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:01 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431781, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:01.455291 5760 init.cc:377] Logged in from keytab as oryx/127.30.73.66@KRBTEST.COM (short username oryx)
I20260811 07:03:01.456844 5760 webserver.cc:460] Webserver started at http://127.30.73.66:40793/ using document root <none> and password file <none>
I20260811 07:03:01.457640 5760 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:01.457800 5760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:01.458178 5760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:01.461184 5760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "4e49822ff2da420088e926ebb5f3d78e"
format_stamp: "Formatted at 2026-08-11 07:03:01 on dist-test-slave-69rg"
server_key: "2e73b2dbcfb64959b3091f09ce07c384"
server_key_iv: "bbb65bb2135f5980acb56ff05712d8ab"
server_key_version: "encryptionkey@0"
I20260811 07:03:01.462081 5760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "4e49822ff2da420088e926ebb5f3d78e"
format_stamp: "Formatted at 2026-08-11 07:03:01 on dist-test-slave-69rg"
server_key: "2e73b2dbcfb64959b3091f09ce07c384"
server_key_iv: "bbb65bb2135f5980acb56ff05712d8ab"
server_key_version: "encryptionkey@0"
I20260811 07:03:01.467563 5760 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:03:01.471081 5777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:01.472486 5760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:03:01.472669 5760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "4e49822ff2da420088e926ebb5f3d78e"
format_stamp: "Formatted at 2026-08-11 07:03:01 on dist-test-slave-69rg"
server_key: "2e73b2dbcfb64959b3091f09ce07c384"
server_key_iv: "bbb65bb2135f5980acb56ff05712d8ab"
server_key_version: "encryptionkey@0"
I20260811 07:03:01.472885 5760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:01.525152 5760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:01.529661 5760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:01.530023 5760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:01.531045 5760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:01.532449 5760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:01.532562 5760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:01.532724 5760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:01.532799 5760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:01.567809 5760 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:39875
I20260811 07:03:01.567900 5905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:39875 every 8 connection(s)
I20260811 07:03:01.569162 5760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:03:01.579442 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 5760
I20260811 07:03:01.579646 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:03:01.580219 31013 external_mini_cluster.cc:1428] Setting key 045998f1e59c637399233523e42de9ae
Aug 11 07:03:01 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431781, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:01.592516 5909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:01.571952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:58587 (local address 127.30.73.126:44089)
0811 07:03:01.572486 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:01.572493 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:01.573465 (+ 972us) server_negotiation.cc:407] Connection header received
0811 07:03:01.575307 (+ 1842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:01.575312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:01.575386 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:01.575477 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:01.576981 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:01.577766 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:01.579485 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:01.580166 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:01.580318 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:01.584326 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:01.584336 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:01.584344 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:01.584394 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:01.588592 (+ 4198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:01.589650 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:01.589658 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:01.589663 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:01.589886 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:01.590384 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:01.590392 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:01.590398 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:01.590814 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:01.590972 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:01.591819 (+ 847us) server_negotiation.cc:299] Negotiation successful
0811 07:03:01.592112 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":299,"threads_started":1}
I20260811 07:03:01.593935 5910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:01.572573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.66:58587)
0811 07:03:01.573300 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:01.573345 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:01.575021 (+ 1676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:01.575678 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:01.575685 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:01.576167 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:01.576827 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:01.576844 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:01.577953 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:01.577957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:01.579326 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:01.579339 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:01.580498 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:01.580506 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:01.580747 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:01.581586 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:01.581610 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:01.584061 (+ 2451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:01.588895 (+ 4834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:01.588904 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:01.588921 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:01.589507 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:01.590007 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:01.590011 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:01.590014 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:01.590265 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:01.590993 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:01.590999 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:01.591407 (+ 408us) client_negotiation.cc:769] Sending connection context
0811 07:03:01.591693 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 07:03:01.592197 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":284,"threads_started":1}
I20260811 07:03:01.595705 5907 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44089
I20260811 07:03:01.596058 5907 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:01.596858 5907 heartbeater.cc:511] Master 127.30.73.126:44089 requested a full tablet report, sending...
I20260811 07:03:01.598628 5533 ts_manager.cc:194] Registered new tserver with Master: 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875)
I20260811 07:03:01.599493 5533 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:58587
WARNING: no policy specified for oryx/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab.
Entry for principal oryx/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab.
I20260811 07:03:01.640969 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44089
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab
--principal=oryx/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:01.983132 5913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:01.983439 5913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:01.983605 5913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:01.991365 5913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:01.991484 5913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:01.991667 5913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:03:01.991721 5754 heartbeater.cc:503] Master 127.30.73.126:44089 was elected leader, sending a full tablet report...
I20260811 07:03:02.002806 5913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab
--principal=oryx/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44089
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:02.004199 5913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:02.005614 5913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:02.020404 5919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:02.020373 5918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:02.020535 5921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:02.021961 5913 server_base.cc:1034] running on GCE node
I20260811 07:03:02.022660 5913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:02.023697 5913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:02.024946 5913 hybrid_clock.cc:648] HybridClock initialized: now 1786431782024895 us; error 43 us; skew 500 ppm
I20260811 07:03:02.025337 5913 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:02 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431782, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:02.028934 5913 init.cc:377] Logged in from keytab as oryx/127.30.73.67@KRBTEST.COM (short username oryx)
I20260811 07:03:02.030673 5913 webserver.cc:460] Webserver started at http://127.30.73.67:44869/ using document root <none> and password file <none>
I20260811 07:03:02.031415 5913 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:02.031569 5913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:02.031893 5913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:02.034958 5913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "ac7beecf786e4d70a39dafbea5f45365"
format_stamp: "Formatted at 2026-08-11 07:03:02 on dist-test-slave-69rg"
server_key: "d20211e00470cb179a6c870104d96531"
server_key_iv: "05008effbd17ff7794682261434f0f4a"
server_key_version: "encryptionkey@0"
I20260811 07:03:02.035838 5913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "ac7beecf786e4d70a39dafbea5f45365"
format_stamp: "Formatted at 2026-08-11 07:03:02 on dist-test-slave-69rg"
server_key: "d20211e00470cb179a6c870104d96531"
server_key_iv: "05008effbd17ff7794682261434f0f4a"
server_key_version: "encryptionkey@0"
I20260811 07:03:02.041582 5913 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260811 07:03:02.045523 5928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:02.047063 5913 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:02.047202 5913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "ac7beecf786e4d70a39dafbea5f45365"
format_stamp: "Formatted at 2026-08-11 07:03:02 on dist-test-slave-69rg"
server_key: "d20211e00470cb179a6c870104d96531"
server_key_iv: "05008effbd17ff7794682261434f0f4a"
server_key_version: "encryptionkey@0"
I20260811 07:03:02.047446 5913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:02.077211 5913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:02.081314 5913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:02.081568 5913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:02.082587 5913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:02.083953 5913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:02.084036 5913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:02.084123 5913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:02.084168 5913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:02.126365 5913 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:45965
I20260811 07:03:02.126439 6056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:45965 every 8 connection(s)
I20260811 07:03:02.127904 5913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:03:02.137735 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 5913
I20260811 07:03:02.137986 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:03:02.138485 31013 external_mini_cluster.cc:1428] Setting key f8283bca2e5ae13db046ad2b2ef34f1b
Aug 11 07:03:02 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431782, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:02.150779 6059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.131472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:41233 (local address 127.30.73.126:44089)
0811 07:03:02.131979 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:02.131984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:02.132975 (+ 991us) server_negotiation.cc:407] Connection header received
0811 07:03:02.134997 (+ 2022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:02.135004 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:02.135105 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:02.135231 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:02.136875 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.137723 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.139487 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.140013 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.140115 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.144383 (+ 4268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:02.144388 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:02.144392 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:02.144428 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:02.147411 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.148266 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.148271 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.148273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.148415 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.148940 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.148944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.148946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.149233 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:02.149370 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:02.150238 (+ 868us) server_negotiation.cc:299] Negotiation successful
0811 07:03:02.150431 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":264,"threads_started":1}
I20260811 07:03:02.151799 6061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.132030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.67:41233)
0811 07:03:02.132800 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:02.132849 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:02.134688 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:02.135497 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:02.135507 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:02.136071 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:02.136679 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.136699 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.137928 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.137935 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.139342 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.139360 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.140272 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.140280 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.140528 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.141347 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:02.141379 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:02.144098 (+ 2719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:02.147582 (+ 3484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.147590 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.147614 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.148092 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.148548 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.148552 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.148554 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.148814 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.149364 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:02.149370 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:02.149737 (+ 367us) client_negotiation.cc:769] Sending connection context
0811 07:03:02.150078 (+ 341us) client_negotiation.cc:240] Negotiation successful
0811 07:03:02.150520 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":324,"threads_started":1}
I20260811 07:03:02.153649 6057 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44089
I20260811 07:03:02.154145 6057 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:02.155336 6057 heartbeater.cc:511] Master 127.30.73.126:44089 requested a full tablet report, sending...
I20260811 07:03:02.158360 5533 ts_manager.cc:194] Registered new tserver with Master: ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67:45965)
I20260811 07:03:02.159301 5533 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:41233
I20260811 07:03:02.168068 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.30.73.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.125.keytab.
Entry for principal oryx/127.30.73.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.125.keytab.
I20260811 07:03:02.226822 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.125:42817
--webserver_interface=127.30.73.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.125.keytab
--principal=oryx/127.30.73.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44089,127.30.73.125:42817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:02.583235 6064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:02.583596 6064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:02.583763 6064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:02.591042 6064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:02.591197 6064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:02.591306 6064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:02.591411 6064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:02.591490 6064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:02.601926 6064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44089,127.30.73.125:42817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.125.keytab
--principal=oryx/127.30.73.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.125:42817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.73.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:02.602313 5907 heartbeater.cc:503] Master 127.30.73.126:44089 was elected leader, sending a full tablet report...
W20260811 07:03:02.602397 6064 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.30.73.126:44089,127.30.73.125:42817'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 07:03:02.603698 6064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:02.605316 6064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:02.618929 6072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:02.618948 6069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:02.619237 6070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:02.619828 6064 server_base.cc:1034] running on GCE node
I20260811 07:03:02.620752 6064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:02.622377 6064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:02.623628 6064 hybrid_clock.cc:648] HybridClock initialized: now 1786431782623565 us; error 31 us; skew 500 ppm
I20260811 07:03:02.624025 6064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:02 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431782, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:02.628113 6064 init.cc:377] Logged in from keytab as oryx/127.30.73.125@KRBTEST.COM (short username oryx)
I20260811 07:03:02.629930 6064 webserver.cc:460] Webserver started at http://127.30.73.125:36181/ using document root <none> and password file <none>
I20260811 07:03:02.630695 6064 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:02.630843 6064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:02.631204 6064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:02.634516 6064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data/instance:
uuid: "3abef8dfca024f7e88d757bbb3d399fe"
format_stamp: "Formatted at 2026-08-11 07:03:02 on dist-test-slave-69rg"
server_key: "d5bd41207d1f7a07dc24e50ee52bcc51"
server_key_iv: "695cec4f7f288c005852b1f4d3b348a7"
server_key_version: "encryptionkey@0"
I20260811 07:03:02.635385 6064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal/instance:
uuid: "3abef8dfca024f7e88d757bbb3d399fe"
format_stamp: "Formatted at 2026-08-11 07:03:02 on dist-test-slave-69rg"
server_key: "d5bd41207d1f7a07dc24e50ee52bcc51"
server_key_iv: "695cec4f7f288c005852b1f4d3b348a7"
server_key_version: "encryptionkey@0"
I20260811 07:03:02.640856 6064 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:03:02.644673 6079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:02.646407 6064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:02.646564 6064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal
uuid: "3abef8dfca024f7e88d757bbb3d399fe"
format_stamp: "Formatted at 2026-08-11 07:03:02 on dist-test-slave-69rg"
server_key: "d5bd41207d1f7a07dc24e50ee52bcc51"
server_key_iv: "695cec4f7f288c005852b1f4d3b348a7"
server_key_version: "encryptionkey@0"
I20260811 07:03:02.646766 6064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:02.664103 6064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:02.669055 6064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:02.669313 6064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:02.689471 6064 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.125:42817
I20260811 07:03:02.689478 6143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.125:42817 every 8 connection(s)
I20260811 07:03:02.691031 6064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
I20260811 07:03:02.692961 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 6064
I20260811 07:03:02.695492 6144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:02.704895 6144 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:03:02 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.125@KRBTEST.COM
Aug 11 07:03:02 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431782, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.125@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:02.720780 6147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.695602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60680 (local address 127.30.73.125:42817)
0811 07:03:02.696534 (+ 932us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:02.696547 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:02.696593 (+ 46us) server_negotiation.cc:407] Connection header received
0811 07:03:02.698480 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:02.698505 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:02.698956 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:02.699353 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:02.701338 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.703016 (+ 1678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.704820 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.705600 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.706230 (+ 630us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.711619 (+ 5389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:02.711627 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:02.711645 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:02.711684 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:02.715541 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.716454 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.716464 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.716474 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.716713 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.717171 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.717177 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.717180 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.717982 (+ 802us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:02.718770 (+ 788us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:02.719127 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 07:03:02.719715 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":441,"threads_started":1}
I20260811 07:03:02.726205 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.708166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40300 (local address 127.30.73.126:44089)
0811 07:03:02.708783 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:02.708790 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:02.709396 (+ 606us) server_negotiation.cc:407] Connection header received
0811 07:03:02.709676 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:02.709680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:02.709774 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:02.709944 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:02.711229 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.712112 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.714352 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.714813 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.715003 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.719668 (+ 4665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:02.719673 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:02.719677 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:02.719729 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:02.723058 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.723907 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.723913 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.723916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.724081 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.724512 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.724518 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.724521 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.724882 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:02.725050 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:02.725526 (+ 476us) server_negotiation.cc:299] Negotiation successful
0811 07:03:02.725791 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":296,"threads_started":1}
I20260811 07:03:02.726250 6149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.708158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40300)
0811 07:03:02.709220 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:02.709281 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:02.709469 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:02.710042 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:02.710050 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:02.710794 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:02.711057 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.711066 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.712268 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.712272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.714159 (+ 1887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.714174 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.715092 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.715099 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.715449 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.716267 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:02.716286 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:02.719436 (+ 3150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:02.723221 (+ 3785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.723231 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.723238 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.723762 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.724227 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.724232 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.724236 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.724391 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.725025 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:02.725033 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:02.725230 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 07:03:02.725423 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 07:03:02.725786 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"thread_start_us":591,"threads_started":1}
I20260811 07:03:02.728363 6144 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:03:02 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431782, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.125@KRBTEST.COM for oryx/127.30.73.125@KRBTEST.COM
I20260811 07:03:02.741902 6149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.729279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.0.0.1:60684)
0811 07:03:02.729461 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:02.729487 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:02.729623 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:02.729976 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:02.729980 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:02.730354 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:02.730479 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.730487 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.731723 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.731730 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.732630 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.732643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.733352 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.733357 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.733519 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.734204 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:02.734221 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:02.736235 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:02.739280 (+ 3045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.739285 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.739289 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.739756 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.740298 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.740306 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.740312 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.740482 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.741037 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:02.741041 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:02.741192 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 07:03:02.741327 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 07:03:02.741556 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 07:03:02.742151 6147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.729140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60684 (local address 127.30.73.125:42817)
0811 07:03:02.729433 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:02.729439 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:02.729557 (+ 118us) server_negotiation.cc:407] Connection header received
0811 07:03:02.729755 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:02.729759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:02.729811 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:02.729958 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:02.730612 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.731556 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.732785 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.733192 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.733323 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.736420 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:02.736425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:02.736428 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:02.736455 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:02.739088 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.739934 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.739939 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.739942 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.740147 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.740618 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.740622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.740623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.740892 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:02.741006 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:02.741439 (+ 433us) server_negotiation.cc:299] Negotiation successful
0811 07:03:02.741720 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":104}
I20260811 07:03:02.747211 6144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: Bootstrap starting.
I20260811 07:03:02.750590 6144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:02.751929 6144 log.cc:824] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:02.755024 6144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: No bootstrap required, opened a new log
I20260811 07:03:02.762646 6144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } }
I20260811 07:03:02.763029 6144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:02.763178 6144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3abef8dfca024f7e88d757bbb3d399fe, State: Initialized, Role: FOLLOWER
I20260811 07:03:02.763840 6144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } }
I20260811 07:03:02.764875 6151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } } }
I20260811 07:03:02.765251 6151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:03:02.766055 6144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: configured and running, proceeding with master startup.
W20260811 07:03:02.776662 6163 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:03:02.777030 6163 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:03:02.779526 6064 master_runner.cc:428] Detected that this master 3abef8dfca024f7e88d757bbb3d399fe is joining an existing cluster
I20260811 07:03:02.779670 6064 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.73.125:42817
WARNING: no policy specified for oryx/127.30.73.124@KRBTEST.COM; defaulting to no policy
I20260811 07:03:02.812011 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.789341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40308 (local address 127.30.73.126:44089)
0811 07:03:02.789733 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:02.789742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:02.790537 (+ 795us) server_negotiation.cc:407] Connection header received
0811 07:03:02.790925 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:02.790935 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:02.791070 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:02.791163 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:02.794140 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.795800 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.799473 (+ 3673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.800204 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.800321 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.803522 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:02.803531 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:02.803536 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:02.803591 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:02.807950 (+ 4359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.808827 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.808833 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.808836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.809014 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.809713 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.809719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.809723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.810205 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:02.810384 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:02.811332 (+ 948us) server_negotiation.cc:299] Negotiation successful
0811 07:03:02.811611 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229}
I20260811 07:03:02.812935 6170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.789348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40308)
0811 07:03:02.790382 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:02.790409 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:02.790712 (+ 303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:02.791959 (+ 1247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:02.791965 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:02.793095 (+ 1130us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:02.793803 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.793857 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.796091 (+ 2234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.796100 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.798712 (+ 2612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.798741 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.800713 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.800719 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.800924 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.801739 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:02.801762 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:02.803236 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:02.808138 (+ 4902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.808144 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.808150 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.808640 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.809162 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.809168 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.809173 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.809493 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.810365 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:02.810373 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:02.810931 (+ 558us) client_negotiation.cc:769] Sending connection context
0811 07:03:02.811165 (+ 234us) client_negotiation.cc:240] Negotiation successful
0811 07:03:02.811972 (+ 807us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"thread_start_us":683,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.124@KRBTEST.COM" created.
I20260811 07:03:02.816944 6147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.789857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60692 (local address 127.30.73.125:42817)
0811 07:03:02.790042 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:02.790050 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:02.799582 (+ 9532us) server_negotiation.cc:407] Connection header received
0811 07:03:02.799834 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:02.799839 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:02.799918 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:02.799990 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:02.801579 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.802936 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.805080 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.806023 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.806138 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.809074 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:02.809081 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:02.809085 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:02.809127 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:02.813603 (+ 4476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.814539 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.814544 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.814550 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.814738 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.815206 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.815211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.815214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.815617 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:02.815786 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:02.816327 (+ 541us) server_negotiation.cc:299] Negotiation successful
0811 07:03:02.816579 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 07:03:02.818185 6172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.789358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.0.0.1:60692)
0811 07:03:02.799487 (+ 10129us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:02.799511 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:02.799704 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:02.800188 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:02.800193 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:02.801009 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:02.801419 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.801435 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.803196 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.803201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.804903 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.804928 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.806515 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.806524 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.806706 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.807516 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:02.807541 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:02.808880 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:02.813779 (+ 4899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.813786 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.813792 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.814396 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.814888 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.814892 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.814896 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.815079 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.815878 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:02.815882 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:02.816036 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 07:03:02.817164 (+ 1128us) client_negotiation.cc:240] Negotiation successful
0811 07:03:02.817558 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9960,"mutex_wait_us":282,"thread_start_us":9421,"threads_started":1}
Aug 11 07:03:02 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431780, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.126@KRBTEST.COM for oryx/127.30.73.125@KRBTEST.COM
I20260811 07:03:02.839036 6147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.822065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60706 (local address 127.30.73.125:42817)
0811 07:03:02.822274 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:02.822282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:02.822885 (+ 603us) server_negotiation.cc:407] Connection header received
0811 07:03:02.823274 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:02.823280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:02.823368 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:02.823480 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:02.824951 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.825968 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.828116 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.828673 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.828874 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.832851 (+ 3977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:02.832865 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:02.832868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:02.832905 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:02.835897 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.836718 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.836725 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.836738 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.836890 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.837315 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.837322 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.837325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.837671 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:02.837884 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:02.838390 (+ 506us) server_negotiation.cc:299] Negotiation successful
0811 07:03:02.838642 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:03:02.839097 6173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.822024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.0.0.1:60706)
0811 07:03:02.822744 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:02.822794 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:02.823040 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:02.823538 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:02.823546 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:02.824262 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:02.824495 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.824505 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.826205 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.826213 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.827937 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.827953 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.828899 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.828905 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.829126 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.829947 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:02.829978 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:02.832595 (+ 2617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:02.836079 (+ 3484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.836098 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.836107 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.836581 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.837017 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.837022 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.837026 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.837192 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.837845 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:02.837855 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:02.838078 (+ 223us) client_negotiation.cc:769] Sending connection context
0811 07:03:02.838300 (+ 222us) client_negotiation.cc:240] Negotiation successful
0811 07:03:02.838657 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":318,"threads_started":1}
I20260811 07:03:02.841468 5533 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.73.125:42817: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe"
member_type: NON_VOTER
last_known_addr {
host: "127.30.73.125"
port: 42817
}
attrs {
promote: true
}
}
dest_uuid: "921f08041d074ff5ad589360142f632c"
cas_config_opid_index: -1
I20260811 07:03:02.842873 5533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } }
I20260811 07:03:02.847313 6177 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3abef8dfca024f7e88d757bbb3d399fe (127.30.73.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } }
I20260811 07:03:02.848212 6112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:02.852994 6177 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.73.125:42817
I20260811 07:03:02.853520 6112 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Refusing update from remote peer 921f08041d074ff5ad589360142f632c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 07:03:02.854130 6176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } }
I20260811 07:03:02.854507 6176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:02.854583 6064 master.cc:537] Master@127.30.73.125:42817 shutting down...
I20260811 07:03:02.856658 6177 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.124.keytab.
Entry for principal oryx/127.30.73.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.124.keytab.
I20260811 07:03:02.860252 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.124:38219
--webserver_interface=127.30.73.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.124.keytab
--principal=oryx/127.30.73.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44089,127.30.73.125:42817,127.30.73.124:38219
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:02.864931 5518 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 07:03:02.868583 5518 consensus_peers.cc:487] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c -> Peer 3abef8dfca024f7e88d757bbb3d399fe (127.30.73.125:42817): Couldn't send request to peer 3abef8dfca024f7e88d757bbb3d399fe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:03:02.876751 6064 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:02.877326 6064 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:02.877562 6064 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: stopping tablet replica
I20260811 07:03:02.886053 6064 master.cc:552] Master@127.30.73.125:42817 shutdown complete.
I20260811 07:03:02.886271 6064 master_runner.cc:305] Clearing existing system tablet
I20260811 07:03:02.886809 6064 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:02.886922 6064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:02.890553 6064 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 07:03:02.892584 6182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:02.892998 6064 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:02.893354 6064 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260811 07:03:02.893467 6064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal
uuid: "3abef8dfca024f7e88d757bbb3d399fe"
format_stamp: "Formatted at 2026-08-11 07:03:02 on dist-test-slave-69rg"
server_key: "d5bd41207d1f7a07dc24e50ee52bcc51"
server_key_iv: "695cec4f7f288c005852b1f4d3b348a7"
server_key_version: "encryptionkey@0"
I20260811 07:03:02.899652 6064 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:02.907315 6064 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 07:03:02.907531 6064 log.cc:1196] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 07:03:02.907996 6064 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: Deleting consensus metadata
I20260811 07:03:02.908291 6064 master_runner.cc:315] Copying system tablet from 127.30.73.126:44089
I20260811 07:03:02.911372 6064 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: tablet copy: Beginning tablet copy session from remote peer at address 127.30.73.126:44089
I20260811 07:03:02.931574 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.912422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40318 (local address 127.30.73.126:44089)
0811 07:03:02.912637 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:02.912645 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:02.914581 (+ 1936us) server_negotiation.cc:407] Connection header received
0811 07:03:02.914889 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:02.914895 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:02.915008 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:02.915133 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:02.916310 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.917625 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.919558 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.920376 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.920527 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.923077 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:02.923085 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:02.923099 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:02.923146 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:02.927447 (+ 4301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.928567 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.928574 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.928579 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.928783 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:02.929429 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:02.929436 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:02.929441 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:02.929883 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:02.930057 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:02.930874 (+ 817us) server_negotiation.cc:299] Negotiation successful
0811 07:03:02.931152 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 07:03:02.931658 6189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:02.912383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40318)
0811 07:03:02.914408 (+ 2025us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:02.914436 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:02.914618 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:02.915251 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:02.915255 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:02.915799 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:02.916120 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.916133 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.917813 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.917890 (+ 77us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.919372 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:02.919389 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:02.920565 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:02.920571 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:02.920778 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:02.921639 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:02.921663 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:02.922813 (+ 1150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:02.927743 (+ 4930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.927750 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.927754 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.928396 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.928937 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:02.928945 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:02.928950 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:02.929240 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:02.930029 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:02.930036 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:02.930486 (+ 450us) client_negotiation.cc:769] Sending connection context
0811 07:03:02.930701 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 07:03:02.931156 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1871,"thread_start_us":1688,"threads_started":1}
I20260811 07:03:02.933087 5554 tablet_copy_service.cc:140] P 921f08041d074ff5ad589360142f632c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3abef8dfca024f7e88d757bbb3d399fe ({username='oryx', principal='oryx/127.30.73.125@KRBTEST.COM'} at 127.0.0.1:40318)
I20260811 07:03:02.934100 5554 tablet_copy_service.cc:161] P 921f08041d074ff5ad589360142f632c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3abef8dfca024f7e88d757bbb3d399fe at {username='oryx', principal='oryx/127.30.73.125@KRBTEST.COM'} at 127.0.0.1:40318: session id = 3abef8dfca024f7e88d757bbb3d399fe-00000000000000000000000000000000
I20260811 07:03:02.940224 5554 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 07:03:02.944250 6064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 07:03:02.951792 6064 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: tablet copy: Starting download of 0 data blocks...
I20260811 07:03:02.952263 6064 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: tablet copy: Starting download of 1 WAL segments...
I20260811 07:03:02.956578 6064 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 07:03:02.962317 5554 tablet_copy_service.cc:342] P 921f08041d074ff5ad589360142f632c: Request end of tablet copy session 3abef8dfca024f7e88d757bbb3d399fe-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.73.125@KRBTEST.COM'} at 127.0.0.1:40318
I20260811 07:03:02.962675 5554 tablet_copy_service.cc:433] P 921f08041d074ff5ad589360142f632c: ending tablet copy session 3abef8dfca024f7e88d757bbb3d399fe-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3abef8dfca024f7e88d757bbb3d399fe
I20260811 07:03:02.977301 6064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:02.981287 6190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:02.981729 6191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:02.984702 6064 server_base.cc:1034] running on GCE node
W20260811 07:03:02.985003 6193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:02.985586 6064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:02.986353 6064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:02.987596 6064 hybrid_clock.cc:648] HybridClock initialized: now 1786431782987504 us; error 49 us; skew 500 ppm
I20260811 07:03:02.987838 6064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:02 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431782, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:02.990178 6064 init.cc:377] Logged in from keytab as oryx/127.30.73.125@KRBTEST.COM (short username oryx)
I20260811 07:03:02.991637 6064 webserver.cc:460] Webserver started at http://127.30.73.125:33879/ using document root <none> and password file <none>
I20260811 07:03:02.992115 6064 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:02.992300 6064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:02.996974 6064 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 07:03:02.999110 6202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:02.999585 6064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:03:02.999737 6064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal
uuid: "3abef8dfca024f7e88d757bbb3d399fe"
format_stamp: "Formatted at 2026-08-11 07:03:02 on dist-test-slave-69rg"
server_key: "d5bd41207d1f7a07dc24e50ee52bcc51"
server_key_iv: "695cec4f7f288c005852b1f4d3b348a7"
server_key_version: "encryptionkey@0"
I20260811 07:03:02.999917 6064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:03.014887 6064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:03.020550 6064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:03.045925 6064 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.125:42817
I20260811 07:03:03.045956 6260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.125:42817 every 8 connection(s)
I20260811 07:03:03.047127 6064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
I20260811 07:03:03.053151 6261 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:03:03.057425 6261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: Bootstrap starting.
I20260811 07:03:03.075525 6261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:03:03.076181 6261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: Bootstrap complete.
I20260811 07:03:03.077426 6261 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } }
I20260811 07:03:03.077718 6261 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3abef8dfca024f7e88d757bbb3d399fe, State: Initialized, Role: LEARNER
I20260811 07:03:03.077996 6261 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } }
I20260811 07:03:03.079034 6264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } }
I20260811 07:03:03.079386 6261 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:03:03.079523 6264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: This master's current role is: LEARNER
I20260811 07:03:03.088157 6276 catalog_manager.cc:1259] Loaded cluster ID: 5fcc663ca6cb488da94262d01760ee58
I20260811 07:03:03.088375 6276 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: loading cluster ID for follower catalog manager: success
I20260811 07:03:03.091889 6276 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: acquiring CA information for follower catalog manager: success
I20260811 07:03:03.094758 6276 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:03:03.173151 6057 heartbeater.cc:503] Master 127.30.73.126:44089 was elected leader, sending a full tablet report...
W20260811 07:03:03.305420 6180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:03.305729 6180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:03.305874 6180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:03.313393 6180 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:03.313519 6180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:03.313566 6180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:03.313625 6180 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:03.313675 6180 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:03.324971 6180 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44089,127.30.73.125:42817,127.30.73.124:38219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.124.keytab
--principal=oryx/127.30.73.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.124:38219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.73.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:03.326608 6180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:03.328203 6180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:03.340458 6282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:03.340539 6285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:03.340613 6283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:03.341992 6180 server_base.cc:1034] running on GCE node
I20260811 07:03:03.342767 6180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:03.344122 6180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:03.345340 6180 hybrid_clock.cc:648] HybridClock initialized: now 1786431783345294 us; error 38 us; skew 500 ppm
I20260811 07:03:03.345640 6180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:03 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431783, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:03.348917 6180 init.cc:377] Logged in from keytab as oryx/127.30.73.124@KRBTEST.COM (short username oryx)
I20260811 07:03:03.350523 6180 webserver.cc:460] Webserver started at http://127.30.73.124:35609/ using document root <none> and password file <none>
I20260811 07:03:03.351295 6180 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:03.351430 6180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:03.351761 6180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:03.355291 6180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data/instance:
uuid: "d1b094721a2d4adb840c9d570fae44a8"
format_stamp: "Formatted at 2026-08-11 07:03:03 on dist-test-slave-69rg"
server_key: "03a6f5aa82f0787626c7597d21fcd445"
server_key_iv: "206a734f9a3365462d68227cf88b6dd9"
server_key_version: "encryptionkey@0"
I20260811 07:03:03.356177 6180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal/instance:
uuid: "d1b094721a2d4adb840c9d570fae44a8"
format_stamp: "Formatted at 2026-08-11 07:03:03 on dist-test-slave-69rg"
server_key: "03a6f5aa82f0787626c7597d21fcd445"
server_key_iv: "206a734f9a3365462d68227cf88b6dd9"
server_key_version: "encryptionkey@0"
I20260811 07:03:03.361804 6180 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:03:03.365433 6292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:03.367142 6180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:03.367350 6180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal
uuid: "d1b094721a2d4adb840c9d570fae44a8"
format_stamp: "Formatted at 2026-08-11 07:03:03 on dist-test-slave-69rg"
server_key: "03a6f5aa82f0787626c7597d21fcd445"
server_key_iv: "206a734f9a3365462d68227cf88b6dd9"
server_key_version: "encryptionkey@0"
I20260811 07:03:03.367533 6180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:03.390587 6180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:03.395321 6180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:03.395634 6180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:03.416010 6180 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.124:38219
I20260811 07:03:03.416044 6354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.124:38219 every 8 connection(s)
I20260811 07:03:03.417517 6180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
I20260811 07:03:03.421270 6355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:03.427606 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 6180
I20260811 07:03:03.428073 6355 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:03:03 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431783, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.124@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
Aug 11 07:03:03 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.124@KRBTEST.COM
I20260811 07:03:03.448886 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.431023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40330 (local address 127.30.73.126:44089)
0811 07:03:03.431275 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.431285 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.431981 (+ 696us) server_negotiation.cc:407] Connection header received
0811 07:03:03.433348 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.433353 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.433419 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.433503 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.434967 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.435701 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.437629 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.438305 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.438408 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.442238 (+ 3830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.442247 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.442255 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.442307 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.445081 (+ 2774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.446152 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.446159 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.446162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.446309 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.446945 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.446950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.446952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.447246 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.447382 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.448261 (+ 879us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.448546 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:03:03.450141 6359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.430917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40330)
0811 07:03:03.431816 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:03.431868 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:03.433061 (+ 1193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:03.433600 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:03.433606 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:03.434426 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:03.434788 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.434804 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.435886 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.435891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.437483 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.437495 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.438545 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.438552 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.438951 (+ 399us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.439792 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:03.439818 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:03.442022 (+ 2204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:03.445231 (+ 3209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.445242 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.445256 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.445973 (+ 717us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.446428 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.446435 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.446442 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.446712 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.447400 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:03.447409 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:03.447836 (+ 427us) client_negotiation.cc:769] Sending connection context
0811 07:03:03.448112 (+ 276us) client_negotiation.cc:240] Negotiation successful
0811 07:03:03.448607 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":40,"thread_start_us":400,"threads_started":1}
I20260811 07:03:03.450520 6358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.429950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59114 (local address 127.30.73.124:38219)
0811 07:03:03.430764 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.430775 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.430811 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:03:03.433061 (+ 2250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.433089 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.433391 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.433595 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.435143 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.436795 (+ 1652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.438314 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.439253 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.439398 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.444062 (+ 4664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.444071 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.444084 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.444119 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.447479 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.448138 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.448146 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.448159 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.448309 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.448779 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.448784 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.448787 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.449222 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.449536 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.449790 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.450040 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":600,"thread_start_us":383,"threads_started":1}
I20260811 07:03:03.451792 6355 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:03:03 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431783, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.124@KRBTEST.COM for oryx/127.30.73.125@KRBTEST.COM
I20260811 07:03:03.472183 6360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.452712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60712 (local address 127.30.73.125:42817)
0811 07:03:03.458362 (+ 5650us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.458368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.458386 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:03:03.458439 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.458443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.458505 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.458599 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.459360 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.460383 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.461656 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.462179 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.462294 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.465630 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.465635 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.465638 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.465699 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.468985 (+ 3286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.469881 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.469892 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.469896 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.470074 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.470574 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.470584 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.470586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.470902 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.471058 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.471563 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.471800 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5517,"thread_start_us":5388,"threads_started":1}
I20260811 07:03:03.472167 6359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.452700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.0.0.1:60712)
0811 07:03:03.452863 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:03.452882 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:03.452968 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:03.458677 (+ 5709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:03.458687 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:03.459036 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:03.459178 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.459186 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.460529 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.460533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.461506 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.461518 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.462380 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.462384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.462525 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.463115 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:03.463146 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:03.465420 (+ 2274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:03.469120 (+ 3700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.469126 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.469131 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.469666 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.470268 (+ 602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.470273 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.470277 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.470426 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.471059 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:03.471065 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:03.471235 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 07:03:03.471412 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 07:03:03.471746 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 07:03:03.473768 6355 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:03:03.474305 6363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.466477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60722 (local address 127.30.73.125:42817)
0811 07:03:03.467230 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.467239 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.467739 (+ 500us) server_negotiation.cc:407] Connection header received
0811 07:03:03.467942 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.467947 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.468027 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.468179 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:03.468644 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.469964 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.472183 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.473222 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.473391 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.473634 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.473840 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.473971 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":338,"threads_started":1}
I20260811 07:03:03.474362 6362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.466353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.0.0.1:60722)
0811 07:03:03.467623 (+ 1270us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:03.467638 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:03.467800 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:03.468222 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:03.468227 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:03.468259 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:03.468492 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.468504 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.470099 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.470105 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.471989 (+ 1884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.472005 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.473421 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.473427 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.473612 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.473672 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 07:03:03.473800 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 07:03:03.473975 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1153,"thread_start_us":1038,"threads_started":1}
I20260811 07:03:03.475476 6232 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260811 07:03:03.476118 6264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 921f08041d074ff5ad589360142f632c. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } }
I20260811 07:03:03.476416 6264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: This master's current role is: LEARNER
Aug 11 07:03:03 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431783, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.124@KRBTEST.COM for oryx/127.30.73.124@KRBTEST.COM
I20260811 07:03:03.487378 6359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.474629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:38219 (local address 127.0.0.1:59116)
0811 07:03:03.474759 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:03.474800 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:03.474899 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:03.475396 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:03.475400 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:03.475866 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:03.476046 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.476058 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.477274 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.477278 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.478298 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.478310 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.479007 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.479015 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.479200 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.479877 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:03.479920 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:03.482144 (+ 2224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:03.485090 (+ 2946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.485093 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.485096 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.485481 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.485915 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.485919 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.485922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.486076 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.486621 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:03.486624 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:03.486749 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 07:03:03.486873 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 07:03:03.487065 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 07:03:03.487466 6358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.474839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59116 (local address 127.30.73.124:38219)
0811 07:03:03.475118 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.475124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.475141 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:03:03.475192 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.475198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.475267 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.475351 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.476213 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.477074 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.478426 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.478835 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.478975 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.482342 (+ 3367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.482346 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.482349 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.482377 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.484959 (+ 2582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.485597 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.485602 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.485604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.485753 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.486204 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.486208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.486210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.486498 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.486616 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.486984 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.487181 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":57}
I20260811 07:03:03.492411 6355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Bootstrap starting.
I20260811 07:03:03.495886 6355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:03.496968 6355 log.cc:824] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:03.499837 6355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: No bootstrap required, opened a new log
I20260811 07:03:03.507884 6355 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } }
I20260811 07:03:03.508261 6355 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:03.508425 6355 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1b094721a2d4adb840c9d570fae44a8, State: Initialized, Role: FOLLOWER
I20260811 07:03:03.509097 6355 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } }
I20260811 07:03:03.510072 6366 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } } }
I20260811 07:03:03.510429 6366 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:03:03.511112 6355 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 07:03:03.520925 6379 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:03:03.521090 6379 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:03:03.524787 6180 master_runner.cc:428] Detected that this master d1b094721a2d4adb840c9d570fae44a8 is joining an existing cluster
I20260811 07:03:03.524943 6180 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.73.124:38219
I20260811 07:03:03.551044 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.529726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40332 (local address 127.30.73.126:44089)
0811 07:03:03.529939 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.529945 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.530160 (+ 215us) server_negotiation.cc:407] Connection header received
0811 07:03:03.530512 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.530521 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.530628 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.530703 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.532685 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.534316 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.539734 (+ 5418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.540468 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.540576 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.543466 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.543476 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.543482 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.543532 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.547338 (+ 3806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.548249 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.548256 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.548259 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.548428 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.548932 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.548937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.548941 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.549324 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.549458 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.550357 (+ 899us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.550647 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:03:03.552559 6387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.529188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40332)
0811 07:03:03.530016 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:03.530052 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:03.530324 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:03.530938 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:03.530943 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:03.531926 (+ 983us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:03.532457 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.532475 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.535799 (+ 3324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.535807 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.539509 (+ 3702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.539530 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.540881 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.540887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.541085 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.541889 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:03.541918 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:03.543237 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:03.547499 (+ 4262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.547506 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.547512 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.548065 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.548579 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.548584 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.548587 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.548782 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.549528 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:03.549531 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:03.549871 (+ 340us) client_negotiation.cc:769] Sending connection context
0811 07:03:03.551737 (+ 1866us) client_negotiation.cc:240] Negotiation successful
0811 07:03:03.552073 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":745,"threads_started":1}
I20260811 07:03:03.555313 6358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.530776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59122 (local address 127.30.73.124:38219)
0811 07:03:03.530937 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.530942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.538480 (+ 7538us) server_negotiation.cc:407] Connection header received
0811 07:03:03.538731 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.538737 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.538800 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.538871 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.540346 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.541444 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.543549 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.544311 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.544478 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.547582 (+ 3104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.547591 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.547598 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.547647 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.552005 (+ 4358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.552863 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.552868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.552871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.553023 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.553665 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.553669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.553673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.554087 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.554228 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.554726 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.554948 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":62}
I20260811 07:03:03.556334 6389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.530437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:38219 (local address 127.0.0.1:59122)
0811 07:03:03.538385 (+ 7948us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:03.538403 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:03.538565 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:03.539056 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:03.539060 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:03.539819 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:03.540192 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.540206 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.541715 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.541728 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.543398 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.543415 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.544688 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.544696 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.545038 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.546115 (+ 1077us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:03.546165 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:03.547420 (+ 1255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:03.552156 (+ 4736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.552160 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.552164 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.552747 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.553366 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.553373 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.553378 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.553537 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.554294 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:03.554298 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:03.554458 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 07:03:03.555543 (+ 1085us) client_negotiation.cc:240] Negotiation successful
0811 07:03:03.555840 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7746,"mutex_wait_us":114,"thread_start_us":7468,"threads_started":1}
I20260811 07:03:03.556617 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 5603
I20260811 07:03:03.558305 6363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.529151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60736 (local address 127.30.73.125:42817)
0811 07:03:03.529368 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.529378 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.537519 (+ 8141us) server_negotiation.cc:407] Connection header received
0811 07:03:03.538148 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.538156 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.538245 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.538324 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.539984 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.541136 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.543330 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.543985 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.544086 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.547442 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.547449 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.547454 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.547496 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.551321 (+ 3825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.552734 (+ 1413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.552739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.552742 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.552896 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.553398 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.553403 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.553408 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.553783 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.553942 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.554543 (+ 601us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.554797 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:03:03.559584 6388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.529308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.0.0.1:60736)
0811 07:03:03.537397 (+ 8089us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:03.537419 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:03.537949 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:03.538550 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:03.538555 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:03.539373 (+ 818us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:03.539797 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.539810 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.541341 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.541346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.543144 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.543159 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.544380 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.544392 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.545047 (+ 655us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.545928 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:03.545951 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:03.547199 (+ 1248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:03.551494 (+ 4295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.551500 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.551504 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.552587 (+ 1083us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.553041 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.553048 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.553054 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.553265 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.554032 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:03.554038 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:03.554256 (+ 218us) client_negotiation.cc:769] Sending connection context
0811 07:03:03.558559 (+ 4303us) client_negotiation.cc:240] Negotiation successful
0811 07:03:03.558898 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7926,"mutex_wait_us":80,"spinlock_wait_cycles":84224,"thread_start_us":7035,"threads_started":1}
Aug 11 07:03:03 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431780, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.126@KRBTEST.COM for oryx/127.30.73.124@KRBTEST.COM
Aug 11 07:03:03 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.65@KRBTEST.COM
I20260811 07:03:03.576579 6362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.560190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:38219 (local address 127.0.0.1:59124)
0811 07:03:03.560371 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:03.560390 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:03.560494 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:03.561260 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:03.561267 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:03.561783 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:03.562009 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.562021 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.563249 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.563255 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.564233 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.564249 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.565330 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.565336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.565551 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.566247 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:03.566266 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:03.569006 (+ 2740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:03.573296 (+ 4290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.573301 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.573306 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.573897 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.574414 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.574419 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.574423 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.574611 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.575407 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:03.575413 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:03.575606 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 07:03:03.575781 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 07:03:03.576179 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 07:03:03.576946 6358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.560719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59124 (local address 127.30.73.124:38219)
0811 07:03:03.560885 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.560891 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.560909 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:03:03.561010 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.561016 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.561123 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.561229 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.562193 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.563088 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.564399 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.565136 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.565276 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.569281 (+ 4005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.569290 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.569295 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.569338 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.573115 (+ 3777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.574068 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.574075 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.574081 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.574248 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.574783 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.574789 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.574793 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.575241 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.575395 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.575932 (+ 537us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.576223 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:03:03.578605 5533 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.73.124:38219: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8"
member_type: NON_VOTER
last_known_addr {
host: "127.30.73.124"
port: 38219
}
attrs {
promote: true
}
}
dest_uuid: "921f08041d074ff5ad589360142f632c"
cas_config_opid_index: 5
I20260811 07:03:03.579771 5533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } }
I20260811 07:03:03.582244 6361 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d1b094721a2d4adb840c9d570fae44a8 (127.30.73.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.585181 6391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.557873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59020 (local address 127.30.73.65:34877)
0811 07:03:03.561801 (+ 3928us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.561811 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.561862 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:03:03.561941 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.561953 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.562279 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.562445 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.564255 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.565451 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.567693 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.568830 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.569582 (+ 752us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.575480 (+ 5898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.575495 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.575511 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.575552 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.579792 (+ 4240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.581108 (+ 1316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.581120 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.581125 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.581312 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.581955 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.581961 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.581965 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.582533 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.584205 (+ 1672us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.584418 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.584743 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3739,"thread_start_us":3983,"threads_started":1}
I20260811 07:03:03.587746 5747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:03.588363 6232 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 LEARNER]: Refusing update from remote peer 921f08041d074ff5ad589360142f632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 07:03:03.590448 6322 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:03.595808 6322 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 FOLLOWER]: Refusing update from remote peer 921f08041d074ff5ad589360142f632c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 07:03:03.602263 6394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 07:03:03.603256 6394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:03.622437 6322 raft_consensus.cc:858] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } }
W20260811 07:03:03.622900 6322 raft_consensus.cc:1565] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } }
I20260811 07:03:03.624976 6232 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d1b094721a2d4adb840c9d570fae44a8 (127.30.73.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.631687 6264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.632114 6264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: This master's current role is: LEARNER
I20260811 07:03:03.634052 6361 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.73.124:38219
I20260811 07:03:03.634856 6180 master.cc:537] Master@127.30.73.124:38219 shutting down...
I20260811 07:03:03.637455 6394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.637849 6394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:03.639470 6392 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: attempting to promote NON_VOTER 3abef8dfca024f7e88d757bbb3d399fe to VOTER
I20260811 07:03:03.640820 6392 consensus_queue.cc:237] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } }
I20260811 07:03:03.646966 6361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.647495 6361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:03.657333 6232 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 LEARNER]: Refusing update from remote peer 921f08041d074ff5ad589360142f632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 07:03:03.658325 6396 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 07:03:03.661923 6396 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3abef8dfca024f7e88d757bbb3d399fe (127.30.73.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.668535 6231 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3abef8dfca024f7e88d757bbb3d399fe (127.30.73.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.673465 6322 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3abef8dfca024f7e88d757bbb3d399fe (127.30.73.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } }
I20260811 07:03:03.677000 6264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.677354 6264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:03:03.678606 6403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.678972 6403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:03.679248 6403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.679436 6403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
W20260811 07:03:03.682384 5514 consensus_peers.cc:487] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c -> Peer d1b094721a2d4adb840c9d570fae44a8 (127.30.73.124:38219): Couldn't send request to peer d1b094721a2d4adb840c9d570fae44a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:03:03.694294 6407 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } }
I20260811 07:03:03.694687 6407 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 07:03:03.694788 6366 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 921f08041d074ff5ad589360142f632c. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } }
I20260811 07:03:03.695017 6366 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 07:03:03.695397 6400 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: NON_VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: true } } }
I20260811 07:03:03.695649 6400 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 07:03:03.697511 6180 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260811 07:03:03.698022 6180 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260811 07:03:03.698226 6180 tablet_replica.cc:330] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: stopping tablet replica
I20260811 07:03:03.716101 6180 master.cc:552] Master@127.30.73.124:38219 shutdown complete.
I20260811 07:03:03.716216 6180 master_runner.cc:305] Clearing existing system tablet
I20260811 07:03:03.716645 6180 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:03.716781 6180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:03.721082 6180 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:03:03.724328 6409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:03.724862 6180 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:03.725751 6180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 07:03:03.725895 6180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal
uuid: "d1b094721a2d4adb840c9d570fae44a8"
format_stamp: "Formatted at 2026-08-11 07:03:03 on dist-test-slave-69rg"
server_key: "03a6f5aa82f0787626c7597d21fcd445"
server_key_iv: "206a734f9a3365462d68227cf88b6dd9"
server_key_version: "encryptionkey@0"
I20260811 07:03:03.731050 6180 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:03.740605 6180 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 07:03:03.740989 6180 log.cc:1196] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 07:03:03.741655 6180 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Deleting consensus metadata
I20260811 07:03:03.741995 6180 master_runner.cc:315] Copying system tablet from 127.30.73.126:44089
I20260811 07:03:03.747623 6180 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: tablet copy: Beginning tablet copy session from remote peer at address 127.30.73.126:44089
I20260811 07:03:03.764688 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 5603
I20260811 07:03:03.766403 6416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.748579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40338)
0811 07:03:03.749371 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:03.749393 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:03.749570 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:03.750117 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:03.750122 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:03.750711 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:03.750982 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.750996 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.752385 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.752391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.754041 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:03.754059 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.755243 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.755254 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:03.755642 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.756482 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:03.756506 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:03.757682 (+ 1176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:03.762568 (+ 4886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.762579 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.762584 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.763178 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.764012 (+ 834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:03.764018 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:03.764022 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:03.764223 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:03.765126 (+ 903us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:03.765133 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:03.765355 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 07:03:03.765523 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 07:03:03.765936 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":488,"threads_started":1}
I20260811 07:03:03.767647 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:03.748637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40338 (local address 127.30.73.126:44089)
0811 07:03:03.749047 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:03.749057 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:03.749506 (+ 449us) server_negotiation.cc:407] Connection header received
0811 07:03:03.749802 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:03.749809 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:03.749943 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:03.750061 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:03.751153 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.752225 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.754204 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:03.754889 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:03.755032 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:03.758012 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:03.758020 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:03.758025 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:03.758092 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:03.762403 (+ 4311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.763437 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.763446 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.763449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.763750 (+ 301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:03.764408 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:03.764415 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:03.764420 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:03.764884 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:03.765058 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:03.766802 (+ 1744us) server_negotiation.cc:299] Negotiation successful
0811 07:03:03.767090 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192}
I20260811 07:03:03.768488 5554 tablet_copy_service.cc:140] P 921f08041d074ff5ad589360142f632c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d1b094721a2d4adb840c9d570fae44a8 ({username='oryx', principal='oryx/127.30.73.124@KRBTEST.COM'} at 127.0.0.1:40338)
I20260811 07:03:03.768702 5554 tablet_copy_service.cc:161] P 921f08041d074ff5ad589360142f632c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d1b094721a2d4adb840c9d570fae44a8 at {username='oryx', principal='oryx/127.30.73.124@KRBTEST.COM'} at 127.0.0.1:40338: session id = d1b094721a2d4adb840c9d570fae44a8-00000000000000000000000000000000
I20260811 07:03:03.773077 5554 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 07:03:03.776182 6180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 07:03:03.785384 6180 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: tablet copy: Starting download of 0 data blocks...
I20260811 07:03:03.786123 6180 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: tablet copy: Starting download of 1 WAL segments...
I20260811 07:03:03.789105 6180 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 07:03:03.794780 5554 tablet_copy_service.cc:342] P 921f08041d074ff5ad589360142f632c: Request end of tablet copy session d1b094721a2d4adb840c9d570fae44a8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.73.124@KRBTEST.COM'} at 127.0.0.1:40338
I20260811 07:03:03.794953 5554 tablet_copy_service.cc:433] P 921f08041d074ff5ad589360142f632c: ending tablet copy session d1b094721a2d4adb840c9d570fae44a8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d1b094721a2d4adb840c9d570fae44a8
I20260811 07:03:03.794904 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:34877
--local_ip_for_outbound_sockets=127.30.73.65
--tserver_master_addrs=127.30.73.126:44089
--webserver_port=43605
--webserver_interface=127.30.73.65
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab
--principal=oryx/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.73.126:44089,127.30.73.125:42817
--tserver_master_addrs=127.30.73.126:44089,127.30.73.125:42817,127.30.73.124:38219 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:03:03.813159 6180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:03.818243 6418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:03.824488 6419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:03.831898 6421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:03.833105 6180 server_base.cc:1034] running on GCE node
I20260811 07:03:03.833539 6180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:03.834420 6180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:03.835605 6180 hybrid_clock.cc:648] HybridClock initialized: now 1786431783835552 us; error 49 us; skew 500 ppm
I20260811 07:03:03.835873 6180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:03 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431783, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:03.838730 6180 init.cc:377] Logged in from keytab as oryx/127.30.73.124@KRBTEST.COM (short username oryx)
I20260811 07:03:03.842387 6180 webserver.cc:460] Webserver started at http://127.30.73.124:43127/ using document root <none> and password file <none>
I20260811 07:03:03.842775 6180 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:03.842897 6180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:03.846570 6180 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260811 07:03:03.848604 6430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:03.849124 6180 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 07:03:03.849263 6180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal
uuid: "d1b094721a2d4adb840c9d570fae44a8"
format_stamp: "Formatted at 2026-08-11 07:03:03 on dist-test-slave-69rg"
server_key: "03a6f5aa82f0787626c7597d21fcd445"
server_key_iv: "206a734f9a3365462d68227cf88b6dd9"
server_key_version: "encryptionkey@0"
I20260811 07:03:03.849450 6180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:03.869302 6180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:03.873944 6180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:03.918479 6180 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.124:38219
I20260811 07:03:03.918582 6490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.124:38219 every 8 connection(s)
I20260811 07:03:03.919857 6180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
I20260811 07:03:03.928092 6491 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:03:03.932147 6491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Bootstrap starting.
I20260811 07:03:03.950946 6491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:03:03.951637 6491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Bootstrap complete.
I20260811 07:03:03.952806 6491 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } }
I20260811 07:03:03.953099 6491 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1b094721a2d4adb840c9d570fae44a8, State: Initialized, Role: LEARNER
I20260811 07:03:03.953436 6491 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } }
I20260811 07:03:03.954309 6494 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:03.954813 6491 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:03:03.954969 6494 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:03:03.973631 6506 catalog_manager.cc:1259] Loaded cluster ID: 5fcc663ca6cb488da94262d01760ee58
I20260811 07:03:03.973780 6506 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: loading cluster ID for follower catalog manager: success
I20260811 07:03:03.977038 6506 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: acquiring CA information for follower catalog manager: success
I20260811 07:03:03.979574 6506 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:03:04.170233 6507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:04.146479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:38219 (local address 127.0.0.1:59138)
0811 07:03:04.162437 (+ 15958us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:04.162465 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:04.162669 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:04.163143 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:04.163148 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:04.163176 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:04.163403 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:04.163414 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.165516 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.165522 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:04.167525 (+ 2003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:04.167545 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.169436 (+ 1891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.169442 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:04.169571 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:04.169598 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:03:04.169673 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 07:03:04.169781 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15782,"thread_start_us":16286,"threads_started":1}
I20260811 07:03:04.170325 6508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:04.146808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59138 (local address 127.30.73.124:38219)
0811 07:03:04.162659 (+ 15851us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:04.162669 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:04.162701 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:03:04.162801 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:04.162808 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:04.162903 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:04.163046 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:04.163698 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.165338 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.167704 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.169197 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.169376 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:04.169665 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:04.169737 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 07:03:04.169922 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15666,"thread_start_us":16148,"threads_started":1}
I20260811 07:03:04.171473 6463 raft_consensus.cc:1203] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 07:03:04.172173 6494 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 921f08041d074ff5ad589360142f632c. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:04.172546 6494 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: This master's current role is: LEARNER
W20260811 07:03:04.299218 6417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:04.299584 6417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:04.299734 6417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:04.308841 6417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:04.308979 6417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:04.309098 6417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:03:04.323343 6417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab
--principal=oryx/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:34877
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=43605
--tserver_master_addrs=127.30.73.126:44089,127.30.73.125:42817,127.30.73.124:38219
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:04.324847 6417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:04.326277 6417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:04.342806 6513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:04.342948 6514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:04.344008 6516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:04.344626 6417 server_base.cc:1034] running on GCE node
I20260811 07:03:04.345353 6417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:04.346909 6417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:04.348229 6417 hybrid_clock.cc:648] HybridClock initialized: now 1786431784348133 us; error 67 us; skew 500 ppm
I20260811 07:03:04.348726 6417 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:04 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431784, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:04.353116 6417 init.cc:377] Logged in from keytab as oryx/127.30.73.65@KRBTEST.COM (short username oryx)
I20260811 07:03:04.355131 6417 webserver.cc:460] Webserver started at http://127.30.73.65:43605/ using document root <none> and password file <none>
I20260811 07:03:04.355959 6417 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:04.356158 6417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:04.365031 6417 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 07:03:04.369603 6524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:04.371959 6417 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260811 07:03:04.372327 6417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "6005d096eb434aaf9971fd63efd0bd14"
format_stamp: "Formatted at 2026-08-11 07:03:00 on dist-test-slave-69rg"
server_key: "43fe9699a7dfdee455ef31546309b17f"
server_key_iv: "11d22fda38ed622917e16f6f29dd1582"
server_key_version: "encryptionkey@0"
I20260811 07:03:04.374023 6417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:04.414161 6417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:04.421290 6417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:04.421643 6417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:04.423583 6417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:04.426244 6417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:04.426406 6417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:04.426553 6417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:04.426663 6417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:04.473768 6417 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:34877
I20260811 07:03:04.474212 6649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:34877 every 8 connection(s)
I20260811 07:03:04.475965 6417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:03:04.482553 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 6417
I20260811 07:03:04.482959 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 5760
Aug 11 07:03:04 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431784, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.125@KRBTEST.COM
Aug 11 07:03:04 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431784, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
Aug 11 07:03:04 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.66@KRBTEST.COM
Aug 11 07:03:04 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431784, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.124@KRBTEST.COM
I20260811 07:03:04.522377 6654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:04.482817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:37045 (local address 127.30.73.125:42817)
0811 07:03:04.483546 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:04.483553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:04.487672 (+ 4119us) server_negotiation.cc:407] Connection header received
0811 07:03:04.490181 (+ 2509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:04.490191 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:04.490323 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:04.490432 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:04.495665 (+ 5233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.496962 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.501466 (+ 4504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.502261 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.502406 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:04.511857 (+ 9451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:04.511865 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:04.511869 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:04.511925 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:04.516433 (+ 4508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:04.518116 (+ 1683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:04.518128 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:04.518132 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:04.518725 (+ 593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:04.519647 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:04.519653 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:04.519657 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:04.520078 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:04.520263 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:04.521539 (+ 1276us) server_negotiation.cc:299] Negotiation successful
0811 07:03:04.521900 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":468,"threads_started":1}
I20260811 07:03:04.523677 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:04.484275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.30.73.65:37045)
0811 07:03:04.487513 (+ 3238us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:04.487539 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:04.489059 (+ 1520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:04.490757 (+ 1698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:04.490769 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:04.491705 (+ 936us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:04.493104 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:04.493141 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.497283 (+ 4142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.497288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:04.501250 (+ 3962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:04.501275 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.505189 (+ 3914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.505200 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:04.505537 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:04.506471 (+ 934us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:04.506505 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:04.511548 (+ 5043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:04.516679 (+ 5131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:04.516695 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:04.516730 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:04.517834 (+ 1104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:04.518934 (+ 1100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:04.518940 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:04.518944 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:04.519477 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:04.520388 (+ 911us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:04.520396 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:04.520953 (+ 557us) client_negotiation.cc:769] Sending connection context
0811 07:03:04.521377 (+ 424us) client_negotiation.cc:240] Negotiation successful
0811 07:03:04.521998 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3056,"mutex_wait_us":85,"thread_start_us":21615,"threads_started":1}
I20260811 07:03:04.526027 6655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:04.483174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:43753 (local address 127.30.73.126:44089)
0811 07:03:04.484831 (+ 1657us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:04.484840 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:04.485861 (+ 1021us) server_negotiation.cc:407] Connection header received
0811 07:03:04.489492 (+ 3631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:04.489503 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:04.489662 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:04.489848 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:04.493401 (+ 3553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.495289 (+ 1888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.503454 (+ 8165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.504513 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.504696 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:04.513003 (+ 8307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:04.513013 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:04.513019 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:04.513073 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:04.518376 (+ 5303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:04.519752 (+ 1376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:04.519759 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:04.519763 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:04.519985 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:04.523175 (+ 3190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:04.523184 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:04.523190 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:04.523616 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:04.524068 (+ 452us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:04.525303 (+ 1235us) server_negotiation.cc:299] Negotiation successful
0811 07:03:04.525581 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1491,"thread_start_us":1395,"threads_started":1}
I20260811 07:03:04.526302 6657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:04.483673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.65:43753)
0811 07:03:04.485583 (+ 1910us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:04.485641 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:04.489048 (+ 3407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:04.490247 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:04.490265 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:04.492109 (+ 1844us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:04.493104 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:04.493141 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.495572 (+ 2431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.495583 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:04.501352 (+ 5769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:04.501379 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.507047 (+ 5668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.507054 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:04.507249 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:04.507979 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:04.508002 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:04.512426 (+ 4424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:04.518789 (+ 6363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:04.518795 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:04.518800 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:04.519580 (+ 780us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:04.520732 (+ 1152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:04.520737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:04.520740 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:04.521080 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:04.524704 (+ 3624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:04.524709 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:04.524904 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 07:03:04.525048 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 07:03:04.525701 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1543,"mutex_wait_us":88,"thread_start_us":1281,"threads_started":1}
I20260811 07:03:04.526607 6658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:04.484240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57120 (local address 127.30.73.66:39875)
0811 07:03:04.496530 (+ 12290us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:04.496540 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:04.496577 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:03:04.496665 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:04.496673 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:04.497094 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:04.501469 (+ 4375us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:04.501771 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.504513 (+ 2742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.506912 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.508010 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.508816 (+ 806us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:04.516532 (+ 7716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:04.516565 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:04.516597 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:04.516659 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:04.522480 (+ 5821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:04.523657 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:04.523670 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:04.523675 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:04.523859 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:04.524339 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:04.524343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:04.524345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:04.524799 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:04.525151 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:04.525468 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 07:03:04.525771 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12074,"thread_start_us":13789,"threads_started":1}
I20260811 07:03:04.527201 6651 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44089
I20260811 07:03:04.527298 6652 heartbeater.cc:347] Connected to a master server at 127.30.73.125:42817
I20260811 07:03:04.527583 6652 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:04.527588 6651 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:04.528090 5900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:04.528661 6651 heartbeater.cc:511] Master 127.30.73.126:44089 requested a full tablet report, sending...
I20260811 07:03:04.529920 6652 heartbeater.cc:511] Master 127.30.73.125:42817 requested a full tablet report, sending...
I20260811 07:03:04.531121 5533 ts_manager.cc:194] Re-registered known tserver with Master: 6005d096eb434aaf9971fd63efd0bd14 (127.30.73.65:34877)
I20260811 07:03:04.532650 5533 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:43753
I20260811 07:03:04.533773 6508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:04.486538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:42533 (local address 127.30.73.124:38219)
0811 07:03:04.486799 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:04.486808 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:04.506778 (+ 19970us) server_negotiation.cc:407] Connection header received
0811 07:03:04.507018 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:04.507027 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:04.507123 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:04.507201 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:04.509973 (+ 2772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.510682 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.512822 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.513349 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.513533 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:04.520797 (+ 7264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:04.520808 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:04.520816 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:04.520865 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:04.524526 (+ 3661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:04.530355 (+ 5829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:04.530362 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:04.530366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:04.530551 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:04.531477 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:04.531482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:04.531486 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:04.531976 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:04.532265 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:04.532708 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 07:03:04.532983 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 07:03:04.533870 6659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:04.486486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:38219 (local address 127.30.73.65:42533)
0811 07:03:04.506648 (+ 20162us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:04.506672 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:04.506822 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:04.507454 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:04.507459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:04.509380 (+ 1921us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:04.509747 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:04.509761 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.510844 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.510852 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:04.512667 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:04.512684 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:04.513866 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:04.513898 (+ 32us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:04.514410 (+ 512us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:04.516135 (+ 1725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:04.516179 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:04.520554 (+ 4375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:04.524648 (+ 4094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:04.524656 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:04.524659 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:04.530195 (+ 5536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:04.530996 (+ 801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:04.531004 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:04.531008 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:04.531181 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:04.532217 (+ 1036us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:04.532222 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:04.532434 (+ 212us) client_negotiation.cc:769] Sending connection context
0811 07:03:04.532582 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 07:03:04.532983 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19978,"thread_start_us":575,"threads_started":1}
I20260811 07:03:04.534539 6220 ts_manager.cc:194] Registered new tserver with Master: 6005d096eb434aaf9971fd63efd0bd14 (127.30.73.65:34877)
I20260811 07:03:04.537748 6650 heartbeater.cc:347] Connected to a master server at 127.30.73.124:38219
I20260811 07:03:04.538100 6650 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:04.538661 6650 heartbeater.cc:511] Master 127.30.73.124:38219 requested a full tablet report, sending...
I20260811 07:03:04.541050 6450 ts_manager.cc:194] Registered new tserver with Master: 6005d096eb434aaf9971fd63efd0bd14 (127.30.73.65:34877)
I20260811 07:03:04.648795 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 5760
I20260811 07:03:04.681809 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:39875
--local_ip_for_outbound_sockets=127.30.73.66
--tserver_master_addrs=127.30.73.126:44089
--webserver_port=40793
--webserver_interface=127.30.73.66
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab
--principal=oryx/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.73.126:44089,127.30.73.125:42817
--tserver_master_addrs=127.30.73.126:44089,127.30.73.125:42817,127.30.73.124:38219 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:03:04.752048 6396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: NON_VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: true } } }
I20260811 07:03:04.752638 6396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:04.755781 6664 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: attempting to promote NON_VOTER d1b094721a2d4adb840c9d570fae44a8 to VOTER
I20260811 07:03:04.756577 6664 consensus_queue.cc:237] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } }
I20260811 07:03:04.759415 6231 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Refusing update from remote peer 921f08041d074ff5ad589360142f632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 07:03:04.759415 6463 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 LEARNER]: Refusing update from remote peer 921f08041d074ff5ad589360142f632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 07:03:04.760406 6664 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 07:03:04.760907 6396 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 07:03:04.765456 6664 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, d1b094721a2d4adb840c9d570fae44a8 (127.30.73.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:04.766595 6231 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, d1b094721a2d4adb840c9d570fae44a8 (127.30.73.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:04.772657 6396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:04.773146 6396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:04.772801 6667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:04.773373 6667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:04.775398 6673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:04.776044 6673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:03:04.780252 6667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:04.780653 6667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:04.781428 6463 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, d1b094721a2d4adb840c9d570fae44a8 (127.30.73.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:04.786311 6674 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "921f08041d074ff5ad589360142f632c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:04.786715 6674 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:03:05.226012 6663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:05.226435 6663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:05.226624 6663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:05.236022 6663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:05.236223 6663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:05.236379 6663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:03:05.250532 6663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab
--principal=oryx/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:39875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=40793
--tserver_master_addrs=127.30.73.126:44089,127.30.73.125:42817,127.30.73.124:38219
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:05.252967 6663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:05.255221 6663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:05.276743 6680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:05.277088 6679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:05.278047 6682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:05.280966 6663 server_base.cc:1034] running on GCE node
I20260811 07:03:05.282382 6663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:05.283985 6663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:05.285269 6663 hybrid_clock.cc:648] HybridClock initialized: now 1786431785285200 us; error 69 us; skew 500 ppm
I20260811 07:03:05.285763 6663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:05 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431785, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:05.290699 6663 init.cc:377] Logged in from keytab as oryx/127.30.73.66@KRBTEST.COM (short username oryx)
I20260811 07:03:05.293610 6663 webserver.cc:460] Webserver started at http://127.30.73.66:40793/ using document root <none> and password file <none>
I20260811 07:03:05.295089 6663 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:05.295353 6663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:05.304241 6663 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:03:05.309314 6689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:05.312019 6663 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260811 07:03:05.312438 6663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "4e49822ff2da420088e926ebb5f3d78e"
format_stamp: "Formatted at 2026-08-11 07:03:01 on dist-test-slave-69rg"
server_key: "2e73b2dbcfb64959b3091f09ce07c384"
server_key_iv: "bbb65bb2135f5980acb56ff05712d8ab"
server_key_version: "encryptionkey@0"
I20260811 07:03:05.313959 6663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:05.359115 6663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:05.369545 6663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:05.370213 6663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:05.371896 6663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:05.374483 6663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:05.374671 6663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:05.375082 6663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:05.375219 6663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:05.429747 6663 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:39875
I20260811 07:03:05.429740 6817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:39875 every 8 connection(s)
I20260811 07:03:05.432034 6663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:03:05.439703 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 6663
I20260811 07:03:05.440172 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 5913
Aug 11 07:03:05 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431785, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
Aug 11 07:03:05 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431785, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.125@KRBTEST.COM
Aug 11 07:03:05 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.67@KRBTEST.COM
Aug 11 07:03:05 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431785, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.124@KRBTEST.COM
I20260811 07:03:05.491595 6824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:05.436562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:50947 (local address 127.30.73.126:44089)
0811 07:03:05.451927 (+ 15365us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:05.451938 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:05.451973 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:03:05.462956 (+ 10983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:05.462966 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:05.463170 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:05.463274 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:05.465524 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.467147 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.469687 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.470793 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.470956 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:05.479598 (+ 8642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:05.479608 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:05.479613 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:05.479674 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:05.485682 (+ 6008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:05.487167 (+ 1485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:05.487175 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:05.487178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:05.487529 (+ 351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:05.488706 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:05.488715 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:05.488721 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:05.489219 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:05.489371 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:05.490780 (+ 1409us) server_negotiation.cc:299] Negotiation successful
0811 07:03:05.491138 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15158,"thread_start_us":15428,"threads_started":1}
I20260811 07:03:05.491612 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:05.436542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:34985 (local address 127.30.73.125:42817)
0811 07:03:05.446555 (+ 10013us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:05.446564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:05.448778 (+ 2214us) server_negotiation.cc:407] Connection header received
0811 07:03:05.455273 (+ 6495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:05.455287 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:05.455730 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:05.455886 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:05.462884 (+ 6998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.464322 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.469164 (+ 4842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.470352 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.470543 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:05.479598 (+ 9055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:05.479608 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:05.479613 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:05.479675 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:05.485365 (+ 5690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:05.487888 (+ 2523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:05.487897 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:05.487901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:05.488154 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:05.488726 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:05.488732 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:05.488735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:05.489215 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:05.489356 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:05.490806 (+ 1450us) server_negotiation.cc:299] Negotiation successful
0811 07:03:05.491147 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9754,"thread_start_us":13628,"threads_started":1}
I20260811 07:03:05.493189 6829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:05.443388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34468 (local address 127.30.73.67:45965)
0811 07:03:05.454628 (+ 11240us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:05.454645 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:05.455745 (+ 1100us) server_negotiation.cc:407] Connection header received
0811 07:03:05.455849 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:05.455861 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:05.456732 (+ 871us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:05.457131 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:05.460280 (+ 3149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.462729 (+ 2449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.465599 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.468998 (+ 3399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.476100 (+ 7102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:05.480233 (+ 4133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:05.480261 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:05.480283 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:05.480341 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:05.486456 (+ 6115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:05.488823 (+ 2367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:05.488838 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:05.488841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:05.489063 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:05.489712 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:05.489718 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:05.489721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:05.490353 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:05.490748 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:05.492306 (+ 1558us) server_negotiation.cc:299] Negotiation successful
0811 07:03:05.492725 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10979,"thread_start_us":10741,"threads_started":1}
I20260811 07:03:05.495605 6827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:05.437407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.66:50947)
0811 07:03:05.449333 (+ 11926us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:05.449359 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:05.462387 (+ 13028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:05.463810 (+ 1423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:05.463816 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:05.464383 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:05.465275 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:05.465286 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.467462 (+ 2176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.467467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:05.469475 (+ 2008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:05.469495 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.471359 (+ 1864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.471374 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:05.471661 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:05.472911 (+ 1250us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:05.472950 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:05.479087 (+ 6137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:05.485941 (+ 6854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:05.485949 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:05.485955 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:05.486741 (+ 786us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:05.488023 (+ 1282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:05.488028 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:05.488031 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:05.488535 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:05.489483 (+ 948us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:05.489487 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:05.490216 (+ 729us) client_negotiation.cc:769] Sending connection context
0811 07:03:05.492432 (+ 2216us) client_negotiation.cc:240] Negotiation successful
0811 07:03:05.493082 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11743,"mutex_wait_us":497,"spinlock_wait_cycles":21376,"thread_start_us":10266,"threads_started":1}
I20260811 07:03:05.495913 6050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:05.495787 6825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:05.437407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.30.73.66:34985)
0811 07:03:05.448494 (+ 11087us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:05.448576 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:05.454600 (+ 6024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:05.457237 (+ 2637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:05.457265 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:05.459573 (+ 2308us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:05.462392 (+ 2819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:05.462434 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.465040 (+ 2606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.465051 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:05.468840 (+ 3789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:05.468860 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.471191 (+ 2331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.471204 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:05.471656 (+ 452us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:05.472944 (+ 1288us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:05.472976 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:05.479100 (+ 6124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:05.485694 (+ 6594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:05.485709 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:05.485738 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:05.487640 (+ 1902us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:05.488347 (+ 707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:05.488354 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:05.488361 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:05.488577 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:05.489461 (+ 884us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:05.489469 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:05.490214 (+ 745us) client_negotiation.cc:769] Sending connection context
0811 07:03:05.492043 (+ 1829us) client_negotiation.cc:240] Negotiation successful
0811 07:03:05.492878 (+ 835us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10635,"mutex_wait_us":204,"spinlock_wait_cycles":79872,"thread_start_us":13820,"threads_started":1}
I20260811 07:03:05.499245 6820 heartbeater.cc:347] Connected to a master server at 127.30.73.125:42817
I20260811 07:03:05.500604 6820 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:05.502705 6820 heartbeater.cc:511] Master 127.30.73.125:42817 requested a full tablet report, sending...
I20260811 07:03:05.499219 6819 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44089
I20260811 07:03:05.504352 6819 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:05.505272 6819 heartbeater.cc:511] Master 127.30.73.126:44089 requested a full tablet report, sending...
I20260811 07:03:05.505796 6220 ts_manager.cc:194] Registered new tserver with Master: 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875)
I20260811 07:03:05.507596 5533 ts_manager.cc:194] Re-registered known tserver with Master: 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875)
I20260811 07:03:05.508965 5533 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:50947
I20260811 07:03:05.509303 6831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:05.456172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:38219 (local address 127.30.73.66:33223)
0811 07:03:05.457426 (+ 1254us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:05.457453 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:05.457996 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:05.463197 (+ 5201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:05.463203 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:05.464027 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:05.465114 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:05.465136 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.467507 (+ 2371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.467516 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:05.469922 (+ 2406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:05.469937 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.471926 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.471933 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:05.472156 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:05.485163 (+ 13007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:05.485199 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:05.490699 (+ 5500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:05.504515 (+ 13816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:05.504522 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:05.504527 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:05.505494 (+ 967us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:05.506276 (+ 782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:05.506282 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:05.506285 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:05.506882 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:05.507886 (+ 1004us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:05.507892 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:05.508115 (+ 223us) client_negotiation.cc:769] Sending connection context
0811 07:03:05.508289 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 07:03:05.508739 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":916,"mutex_wait_us":73,"thread_start_us":1231,"threads_started":1}
I20260811 07:03:05.509307 6830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:05.449989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:33223 (local address 127.30.73.124:38219)
0811 07:03:05.462477 (+ 12488us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:05.462485 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:05.462512 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:03:05.462591 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:05.462597 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:05.462698 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:05.462841 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:05.465407 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.467168 (+ 1761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.470329 (+ 3161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:05.471290 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:05.471605 (+ 315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:05.491061 (+ 19456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:05.491071 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:05.491076 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:05.491134 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:05.504231 (+ 13097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:05.505721 (+ 1490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:05.505728 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:05.505732 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:05.506100 (+ 368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:05.507090 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:05.507096 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:05.507099 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:05.507680 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:05.507903 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:05.508521 (+ 618us) server_negotiation.cc:299] Negotiation successful
0811 07:03:05.508866 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12294,"thread_start_us":12146,"threads_started":1}
I20260811 07:03:05.511008 6818 heartbeater.cc:347] Connected to a master server at 127.30.73.124:38219
I20260811 07:03:05.511224 6818 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:05.511807 6818 heartbeater.cc:511] Master 127.30.73.124:38219 requested a full tablet report, sending...
I20260811 07:03:05.513638 6450 ts_manager.cc:194] Registered new tserver with Master: 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875)
I20260811 07:03:05.540205 6651 heartbeater.cc:503] Master 127.30.73.126:44089 was elected leader, sending a full tablet report...
I20260811 07:03:05.613304 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 5913
I20260811 07:03:05.644992 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:45965
--local_ip_for_outbound_sockets=127.30.73.67
--tserver_master_addrs=127.30.73.126:44089
--webserver_port=44869
--webserver_interface=127.30.73.67
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab
--principal=oryx/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.73.126:44089,127.30.73.125:42817
--tserver_master_addrs=127.30.73.126:44089,127.30.73.125:42817,127.30.73.124:38219 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:06.147688 6833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:06.148098 6833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:06.148272 6833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:06.156641 6833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:06.156844 6833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:06.157037 6833 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:03:06.171171 6833 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab
--principal=oryx/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:45965
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=44869
--tserver_master_addrs=127.30.73.126:44089,127.30.73.125:42817,127.30.73.124:38219
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:06.172966 6833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:06.174933 6833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:06.196144 6838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:06.195914 6839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:06.196815 6841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:06.198722 6833 server_base.cc:1034] running on GCE node
I20260811 07:03:06.199681 6833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:06.200922 6833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:06.204406 6833 hybrid_clock.cc:648] HybridClock initialized: now 1786431786204124 us; error 259 us; skew 500 ppm
I20260811 07:03:06.205073 6833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:06 dist-test-slave-69rg krb5kdc[5480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431786, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:06.210345 6833 init.cc:377] Logged in from keytab as oryx/127.30.73.67@KRBTEST.COM (short username oryx)
I20260811 07:03:06.213806 6833 webserver.cc:460] Webserver started at http://127.30.73.67:44869/ using document root <none> and password file <none>
I20260811 07:03:06.214876 6833 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:06.215049 6833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:06.222555 6833 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:03:06.227671 6849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:06.231058 6833 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.006s sys 0.000s
I20260811 07:03:06.231901 6833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "ac7beecf786e4d70a39dafbea5f45365"
format_stamp: "Formatted at 2026-08-11 07:03:02 on dist-test-slave-69rg"
server_key: "d20211e00470cb179a6c870104d96531"
server_key_iv: "05008effbd17ff7794682261434f0f4a"
server_key_version: "encryptionkey@0"
I20260811 07:03:06.234357 6833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:06.296332 6833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:06.301730 6833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:06.302138 6833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:06.303447 6833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:06.305466 6833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:06.305567 6833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:06.305645 6833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:06.305703 6833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:06.396600 6833 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:45965
I20260811 07:03:06.396672 6974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:45965 every 8 connection(s)
I20260811 07:03:06.398523 6833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:03:06.407159 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 6833
Aug 11 07:03:06 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431786, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.124@KRBTEST.COM
Aug 11 07:03:06 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431786, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
Aug 11 07:03:06 dist-test-slave-69rg krb5kdc[5480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431786, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.125@KRBTEST.COM
I20260811 07:03:06.507040 6989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.434212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:50299 (local address 127.30.73.124:38219)
0811 07:03:06.440631 (+ 6419us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.440642 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.445249 (+ 4607us) server_negotiation.cc:407] Connection header received
0811 07:03:06.461195 (+ 15946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.461201 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.461297 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.461417 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:06.466370 (+ 4953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.467625 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.473138 (+ 5513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.474933 (+ 1795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.475143 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.486941 (+ 11798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:06.486951 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:06.486956 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:06.487021 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:06.497440 (+ 10419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.499243 (+ 1803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.499251 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.499255 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.499429 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.500040 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.500046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.500049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.500359 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:06.500510 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.503045 (+ 2535us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.505834 (+ 2789us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":835,"server-negotiator.queue_time_us":6180,"thread_start_us":8282,"threads_started":1}
I20260811 07:03:06.509714 6995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.447641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59152 (local address 127.30.73.124:38219)
0811 07:03:06.459023 (+ 11382us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.459034 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.472319 (+ 13285us) server_negotiation.cc:407] Connection header received
0811 07:03:06.473539 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.473547 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.473659 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.473881 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:06.476419 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.477922 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.480339 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.481331 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.481485 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.491845 (+ 10360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:06.491854 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:06.491860 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:06.491905 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:06.497440 (+ 5535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.498500 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.498506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.498509 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.498682 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.499730 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.499735 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.499739 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.500166 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:06.502779 (+ 2613us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.503000 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.508996 (+ 5996us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11166,"spinlock_wait_cycles":467328,"thread_start_us":10982,"threads_started":1}
I20260811 07:03:06.513852 6819 heartbeater.cc:503] Master 127.30.73.126:44089 was elected leader, sending a full tablet report...
I20260811 07:03:06.517114 6981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.406600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.30.73.67:39721)
0811 07:03:06.427418 (+ 20818us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.427533 (+ 115us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.464242 (+ 36709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.468150 (+ 3908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.468156 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.468625 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:06.469157 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.469170 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.470915 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.470922 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.484927 (+ 14005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.484957 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.490504 (+ 5547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.490514 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.490776 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.491667 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:06.491694 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:06.495677 (+ 3983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:06.506563 (+ 10886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:06.506569 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:06.506573 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:06.507259 (+ 686us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:06.509947 (+ 2688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:06.509954 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:06.509958 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:06.510265 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:06.511075 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:06.511084 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:06.511268 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.511407 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.512819 (+ 1412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18242,"mutex_wait_us":11495,"thread_start_us":17771,"threads_started":1}
I20260811 07:03:06.518901 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.405650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:39721 (local address 127.30.73.125:42817)
0811 07:03:06.418141 (+ 12491us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.418151 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.427737 (+ 9586us) server_negotiation.cc:407] Connection header received
0811 07:03:06.464503 (+ 36766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.464513 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.464611 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.464720 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:06.469371 (+ 4651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.470698 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.485232 (+ 14534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.485979 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.486350 (+ 371us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.496444 (+ 10094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:06.496469 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:06.496484 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:06.496572 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:06.505514 (+ 8942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.508524 (+ 3010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.508534 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.508537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.508742 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.510453 (+ 1711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.510458 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.510461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.510908 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:06.511717 (+ 809us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.511883 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.512169 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12295,"thread_start_us":12117,"threads_started":1}
I20260811 07:03:06.519680 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.441916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40344 (local address 127.30.73.126:44089)
0811 07:03:06.468243 (+ 26327us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.468249 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.468268 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:03:06.468319 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.468324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.468405 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.468515 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:06.480231 (+ 11716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.481589 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.487449 (+ 5860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.488491 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.488662 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.494985 (+ 6323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:06.494995 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:06.495001 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:06.495057 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:06.505129 (+ 10072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.511446 (+ 6317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.511453 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.511456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.511685 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.515201 (+ 3516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.515209 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.515213 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.516104 (+ 891us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:06.516312 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.516989 (+ 677us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.517616 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":428,"server-negotiator.queue_time_us":26136,"spinlock_wait_cycles":2816,"thread_start_us":25971,"threads_started":1}
I20260811 07:03:06.520442 6982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.406600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.67:52397)
0811 07:03:06.432152 (+ 25552us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.432182 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.460632 (+ 28450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.463909 (+ 3277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.463925 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.466882 (+ 2957us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:06.467232 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.467245 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.468896 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.468901 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.473928 (+ 5027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.473964 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.478954 (+ 4990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.478962 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.479214 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.481743 (+ 2529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:06.481772 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:06.497958 (+ 16186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:06.509863 (+ 11905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:06.509872 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:06.509875 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:06.511355 (+ 1480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:06.514362 (+ 3007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:06.514369 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:06.514376 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:06.514989 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:06.517639 (+ 2650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:06.517646 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:06.518492 (+ 846us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.518660 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.519491 (+ 831us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24777,"mutex_wait_us":604,"thread_start_us":16657,"threads_started":1}
I20260811 07:03:06.521183 6977 heartbeater.cc:347] Connected to a master server at 127.30.73.125:42817
I20260811 07:03:06.521651 6977 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:06.522022 6980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.405873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:52397 (local address 127.30.73.126:44089)
0811 07:03:06.420921 (+ 15048us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.420932 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.432313 (+ 11381us) server_negotiation.cc:407] Connection header received
0811 07:03:06.461249 (+ 28936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.461256 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.461355 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.461480 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:06.467485 (+ 6005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.468652 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.474307 (+ 5655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.476429 (+ 2122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.476579 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.498248 (+ 21669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:06.498256 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:06.498261 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:06.498330 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:06.508525 (+ 10195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.513759 (+ 5234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.513766 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.513769 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.514043 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.515148 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.515156 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.515161 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.515753 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:06.515910 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.519568 (+ 3658us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.520194 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":14839,"spinlock_wait_cycles":4352,"thread_start_us":15072,"threads_started":1}
I20260811 07:03:06.523038 6993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.442573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60744 (local address 127.30.73.125:42817)
0811 07:03:06.459716 (+ 17143us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.459723 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.459748 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:03:06.459859 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.459865 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.459966 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.460114 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:06.464959 (+ 4845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.466113 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.472666 (+ 6553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.477628 (+ 4962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.477796 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.489009 (+ 11213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:06.489017 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:06.489022 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:06.489304 (+ 282us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:06.506022 (+ 16718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.508759 (+ 2737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.508764 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.508769 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.508938 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:06.511897 (+ 2959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:06.511901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:06.511904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:06.512228 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:06.512478 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.521808 (+ 9330us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.522192 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16973,"thread_start_us":16401,"threads_started":1}
I20260811 07:03:06.523057 6977 heartbeater.cc:511] Master 127.30.73.125:42817 requested a full tablet report, sending...
I20260811 07:03:06.523952 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.433798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:38219 (local address 127.30.73.67:50299)
0811 07:03:06.445086 (+ 11288us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.445108 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.460632 (+ 15524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.463909 (+ 3277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.463925 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.465152 (+ 1227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:06.466150 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.466183 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.468812 (+ 2629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.468821 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.472952 (+ 4131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.472969 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.477744 (+ 4775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.477757 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.478417 (+ 660us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.479769 (+ 1352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:06.479814 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:06.485376 (+ 5562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:06.498257 (+ 12881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:06.498270 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:06.498295 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:06.499083 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:06.499575 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:06.499583 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:06.499605 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:06.499898 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:06.500993 (+ 1095us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:06.501009 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:06.502523 (+ 1514us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.503150 (+ 627us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.515550 (+ 12400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11138,"mutex_wait_us":1932,"thread_start_us":9447,"threads_started":1}
I20260811 07:03:06.525457 6976 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44089
I20260811 07:03:06.525645 6976 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:06.526355 6219 ts_manager.cc:194] Registered new tserver with Master: ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67:45965)
I20260811 07:03:06.527423 6975 heartbeater.cc:347] Connected to a master server at 127.30.73.124:38219
I20260811 07:03:06.528071 6975 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:06.528779 6976 heartbeater.cc:511] Master 127.30.73.126:44089 requested a full tablet report, sending...
I20260811 07:03:06.529006 6975 heartbeater.cc:511] Master 127.30.73.124:38219 requested a full tablet report, sending...
I20260811 07:03:06.530180 5533 ts_manager.cc:194] Re-registered known tserver with Master: ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67:45965)
I20260811 07:03:06.530705 6450 ts_manager.cc:194] Registered new tserver with Master: ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67:45965)
I20260811 07:03:06.531286 5533 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:52397
I20260811 07:03:06.543090 5533 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:03:06.559372 5533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:03:06.624740 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.594336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39875 (local address 127.0.0.1:57124)
0811 07:03:06.597908 (+ 3572us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.597943 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.600313 (+ 2370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.602666 (+ 2353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.602673 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.602754 (+ 81us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:06.603183 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.603206 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.610910 (+ 7704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.610918 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.618327 (+ 7409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.618342 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.623594 (+ 5252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.623605 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.623822 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.623871 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.623954 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.624160 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2444,"thread_start_us":1877,"threads_started":1}
I20260811 07:03:06.626199 7009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.594454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57124 (local address 127.30.73.66:39875)
0811 07:03:06.601234 (+ 6780us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.601247 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.601277 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:03:06.601398 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.601405 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.601636 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.602375 (+ 739us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:06.603530 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.610383 (+ 6853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.618563 (+ 8180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.623295 (+ 4732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.625215 (+ 1920us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.625501 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.625606 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.625838 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6565,"thread_start_us":6421,"threads_started":1}
I20260811 07:03:06.629318 7013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.604307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:45965 (local address 127.0.0.1:34478)
0811 07:03:06.616891 (+ 12584us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.616924 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.617120 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.619408 (+ 2288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.619413 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.619450 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:06.619858 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.619869 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.623317 (+ 3448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.623326 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.625896 (+ 2570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.625914 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.628326 (+ 2412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.628333 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.628533 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.628577 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.628681 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.628841 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11848,"thread_start_us":11403,"threads_started":1}
I20260811 07:03:06.630852 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.604381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34478 (local address 127.30.73.67:45965)
0811 07:03:06.616627 (+ 12246us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.616640 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.618077 (+ 1437us) server_negotiation.cc:407] Connection header received
0811 07:03:06.618285 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.618295 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.618906 (+ 611us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.619432 (+ 526us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:06.620114 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.623129 (+ 3015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.626102 (+ 2973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.628053 (+ 1951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.628204 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.628431 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.629923 (+ 1492us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.630405 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11686,"thread_start_us":9721,"threads_started":1}
I20260811 07:03:06.631832 7012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.598456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59024 (local address 127.30.73.65:34877)
0811 07:03:06.603153 (+ 4697us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.603168 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.610021 (+ 6853us) server_negotiation.cc:407] Connection header received
0811 07:03:06.610251 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.610267 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.610903 (+ 636us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.611219 (+ 316us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:06.618204 (+ 6985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.622836 (+ 4632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.625167 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.628407 (+ 3240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.630253 (+ 1846us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.630830 (+ 577us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.630954 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.631191 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4460,"thread_start_us":4331,"threads_started":1}
I20260811 07:03:06.632175 7011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.596906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:34877 (local address 127.0.0.1:59024)
0811 07:03:06.603852 (+ 6946us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.603881 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.604025 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.612542 (+ 8517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.612550 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.612600 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:06.617015 (+ 4415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.617043 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.623050 (+ 6007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.623056 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.624947 (+ 1891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.624967 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.629082 (+ 4115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.629095 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.629378 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.629730 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.629896 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.630138 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5690,"mutex_wait_us":23,"thread_start_us":5407,"threads_started":1}
I20260811 07:03:06.632903 6744 tablet_service.cc:1467] Processing CreateTablet for tablet 9429470e3d9e43c1b92c85e0c2689160 (DEFAULT_TABLE table=test-table [id=83f46a58de134daaba0c0e06db23a7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:06.637154 6744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9429470e3d9e43c1b92c85e0c2689160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:06.637609 6902 tablet_service.cc:1467] Processing CreateTablet for tablet 9429470e3d9e43c1b92c85e0c2689160 (DEFAULT_TABLE table=test-table [id=83f46a58de134daaba0c0e06db23a7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:06.641167 6902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9429470e3d9e43c1b92c85e0c2689160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:06.641091 6580 tablet_service.cc:1467] Processing CreateTablet for tablet 9429470e3d9e43c1b92c85e0c2689160 (DEFAULT_TABLE table=test-table [id=83f46a58de134daaba0c0e06db23a7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:06.642535 6580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9429470e3d9e43c1b92c85e0c2689160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:06.661592 7017 tablet_bootstrap.cc:492] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: Bootstrap starting.
I20260811 07:03:06.664330 7018 tablet_bootstrap.cc:492] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: Bootstrap starting.
I20260811 07:03:06.670346 7017 tablet_bootstrap.cc:654] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:06.670629 7019 tablet_bootstrap.cc:492] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: Bootstrap starting.
I20260811 07:03:06.672899 7017 log.cc:824] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:06.673106 7018 tablet_bootstrap.cc:654] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:06.674934 7018 log.cc:824] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:06.676393 7019 tablet_bootstrap.cc:654] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:06.678447 7018 tablet_bootstrap.cc:492] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: No bootstrap required, opened a new log
I20260811 07:03:06.678375 7019 log.cc:824] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:06.678731 7017 tablet_bootstrap.cc:492] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: No bootstrap required, opened a new log
I20260811 07:03:06.678872 7018 ts_tablet_manager.cc:1397] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260811 07:03:06.679052 7017 ts_tablet_manager.cc:1397] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.003s
I20260811 07:03:06.682519 7019 tablet_bootstrap.cc:492] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: No bootstrap required, opened a new log
I20260811 07:03:06.682843 7019 ts_tablet_manager.cc:1397] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260811 07:03:06.690793 7017 raft_consensus.cc:348] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.691421 7017 raft_consensus.cc:374] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:06.691535 7017 raft_consensus.cc:729] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6005d096eb434aaf9971fd63efd0bd14, State: Initialized, Role: FOLLOWER
I20260811 07:03:06.692394 7017 consensus_queue.cc:260] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.695079 7017 ts_tablet_manager.cc:1428] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260811 07:03:06.694854 7018 raft_consensus.cc:348] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.695842 7018 raft_consensus.cc:374] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:06.695992 7018 raft_consensus.cc:729] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e49822ff2da420088e926ebb5f3d78e, State: Initialized, Role: FOLLOWER
I20260811 07:03:06.696023 7019 raft_consensus.cc:348] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.696962 7018 consensus_queue.cc:260] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.697260 7019 raft_consensus.cc:374] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:06.697448 7019 raft_consensus.cc:729] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac7beecf786e4d70a39dafbea5f45365, State: Initialized, Role: FOLLOWER
I20260811 07:03:06.698661 7019 consensus_queue.cc:260] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.703229 7019 ts_tablet_manager.cc:1428] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: Time spent starting tablet: real 0.020s user 0.007s sys 0.012s
I20260811 07:03:06.703612 6976 heartbeater.cc:503] Master 127.30.73.126:44089 was elected leader, sending a full tablet report...
I20260811 07:03:06.711079 7018 ts_tablet_manager.cc:1428] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: Time spent starting tablet: real 0.032s user 0.024s sys 0.004s
W20260811 07:03:06.735601 6653 tablet.cc:2369] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:03:06.811133 7027 raft_consensus.cc:482] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:03:06.811630 7027 raft_consensus.cc:504] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.815801 7027 leader_election.cc:288] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875), 6005d096eb434aaf9971fd63efd0bd14 (127.30.73.65:34877)
I20260811 07:03:06.819118 7025 raft_consensus.cc:482] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:03:06.819522 7025 raft_consensus.cc:504] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.821669 7025 leader_election.cc:288] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875), ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67:45965)
I20260811 07:03:06.828838 6982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.816653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:34877 (local address 127.30.73.67:42981)
0811 07:03:06.816830 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.816846 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.816938 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.817564 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.817569 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.817596 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:06.817901 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.817915 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.819430 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.819436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.822135 (+ 2699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.822156 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.826725 (+ 4569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.826736 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.827104 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.827183 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.827290 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.827547 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":346}
I20260811 07:03:06.831127 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.816083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39875 (local address 127.30.73.67:59571)
0811 07:03:06.816334 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.816358 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.816530 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.818387 (+ 1857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.818391 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.818417 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:06.818605 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.818616 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.819841 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.819850 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.822169 (+ 2319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.822190 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.828837 (+ 6647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.828858 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.829381 (+ 523us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.829571 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.829690 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.829925 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":5}
I20260811 07:03:06.832847 7012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.816868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:42981 (local address 127.30.73.65:34877)
0811 07:03:06.817165 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.817172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.817195 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:03:06.817283 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.817289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.817382 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.817502 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:06.818099 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.819264 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.822380 (+ 3116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.824985 (+ 2605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.826307 (+ 1322us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.826435 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.829397 (+ 2962us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.832176 (+ 2779us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 07:03:06.834295 7009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.817802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:59571 (local address 127.30.73.66:39875)
0811 07:03:06.818087 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.818093 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.818117 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:03:06.818178 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.818181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.818246 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.818353 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:06.818761 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.819678 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.822400 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.825322 (+ 2922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.826164 (+ 842us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.826269 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.831872 (+ 5603us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.833949 (+ 2077us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:03:06.835007 6602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9429470e3d9e43c1b92c85e0c2689160" candidate_uuid: "ac7beecf786e4d70a39dafbea5f45365" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6005d096eb434aaf9971fd63efd0bd14" is_pre_election: true
I20260811 07:03:06.835376 6767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9429470e3d9e43c1b92c85e0c2689160" candidate_uuid: "ac7beecf786e4d70a39dafbea5f45365" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e49822ff2da420088e926ebb5f3d78e" is_pre_election: true
I20260811 07:03:06.835695 6602 raft_consensus.cc:2454] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac7beecf786e4d70a39dafbea5f45365 in term 0.
I20260811 07:03:06.835933 6767 raft_consensus.cc:2454] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac7beecf786e4d70a39dafbea5f45365 in term 0.
I20260811 07:03:06.836825 6853 leader_election.cc:302] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e49822ff2da420088e926ebb5f3d78e, ac7beecf786e4d70a39dafbea5f45365; no voters:
I20260811 07:03:06.837690 7027 raft_consensus.cc:2781] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:03:06.837893 7027 raft_consensus.cc:482] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:03:06.838021 7027 raft_consensus.cc:3037] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:06.839823 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.827068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:56819 (local address 127.30.73.67:45965)
0811 07:03:06.827582 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.827591 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.827620 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:03:06.827722 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.827732 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.827882 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.828017 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:06.832015 (+ 3998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.833038 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.837041 (+ 4003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.838444 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.838589 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.838687 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.839380 (+ 693us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.839548 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260811 07:03:06.839890 7030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.823088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:45965 (local address 127.30.73.65:56819)
0811 07:03:06.825078 (+ 1990us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.825146 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.825610 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.829331 (+ 3721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.829338 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.829387 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:06.831412 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.831434 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.833682 (+ 2248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.833692 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.836632 (+ 2940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.836799 (+ 167us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.838928 (+ 2129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.838936 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.839125 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.839187 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.839295 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.839462 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"thread_start_us":705,"threads_started":1}
I20260811 07:03:06.841686 7027 raft_consensus.cc:504] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.843088 6767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9429470e3d9e43c1b92c85e0c2689160" candidate_uuid: "ac7beecf786e4d70a39dafbea5f45365" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e49822ff2da420088e926ebb5f3d78e"
I20260811 07:03:06.843354 6767 raft_consensus.cc:3037] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:06.844229 6926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9429470e3d9e43c1b92c85e0c2689160" candidate_uuid: "6005d096eb434aaf9971fd63efd0bd14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac7beecf786e4d70a39dafbea5f45365" is_pre_election: true
I20260811 07:03:06.844175 6602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9429470e3d9e43c1b92c85e0c2689160" candidate_uuid: "ac7beecf786e4d70a39dafbea5f45365" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6005d096eb434aaf9971fd63efd0bd14"
I20260811 07:03:06.845218 6926 raft_consensus.cc:2379] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6005d096eb434aaf9971fd63efd0bd14 in current term 1: Already voted for candidate ac7beecf786e4d70a39dafbea5f45365 in this term.
I20260811 07:03:06.845191 6602 raft_consensus.cc:3037] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:06.854524 7028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.821941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39875 (local address 127.30.73.65:47007)
0811 07:03:06.822676 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:06.822695 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:06.822831 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:06.835493 (+ 12662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:06.835499 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:06.835530 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:06.835962 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.835977 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.838554 (+ 2577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.838568 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.840991 (+ 2423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:06.841011 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.847463 (+ 6452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.847474 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:06.849039 (+ 1565us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.849093 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 07:03:06.849732 (+ 639us) client_negotiation.cc:240] Negotiation successful
0811 07:03:06.853774 (+ 4042us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":756,"threads_started":1}
I20260811 07:03:06.856228 6602 raft_consensus.cc:2454] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac7beecf786e4d70a39dafbea5f45365 in term 1.
I20260811 07:03:06.856464 7009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.822430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:47007 (local address 127.30.73.66:39875)
0811 07:03:06.834899 (+ 12469us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.834916 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.834941 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:03:06.835024 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.835029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.835128 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.836137 (+ 1009us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:06.836285 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.837606 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.841699 (+ 4093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.846142 (+ 4443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.855442 (+ 9300us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.855553 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.855631 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.855792 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12068,"threads_started":1}
I20260811 07:03:06.856843 6853 leader_election.cc:302] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6005d096eb434aaf9971fd63efd0bd14, ac7beecf786e4d70a39dafbea5f45365; no voters:
I20260811 07:03:06.856900 6767 raft_consensus.cc:2454] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac7beecf786e4d70a39dafbea5f45365 in term 1.
I20260811 07:03:06.857578 7031 raft_consensus.cc:2781] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:06.842540 7027 leader_election.cc:288] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [CANDIDATE]: Term 1 election: Requested vote from peers 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875), 6005d096eb434aaf9971fd63efd0bd14 (127.30.73.65:34877)
I20260811 07:03:06.857939 6767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9429470e3d9e43c1b92c85e0c2689160" candidate_uuid: "6005d096eb434aaf9971fd63efd0bd14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e49822ff2da420088e926ebb5f3d78e" is_pre_election: true
I20260811 07:03:06.858346 6767 raft_consensus.cc:2379] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6005d096eb434aaf9971fd63efd0bd14 in current term 1: Already voted for candidate ac7beecf786e4d70a39dafbea5f45365 in this term.
I20260811 07:03:06.859330 6530 leader_election.cc:302] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6005d096eb434aaf9971fd63efd0bd14; no voters: 4e49822ff2da420088e926ebb5f3d78e, ac7beecf786e4d70a39dafbea5f45365
I20260811 07:03:06.859939 7025 raft_consensus.cc:2726] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 07:03:06.862155 7031 raft_consensus.cc:686] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 1 LEADER]: Becoming Leader. State: Replica: ac7beecf786e4d70a39dafbea5f45365, State: Running, Role: LEADER
I20260811 07:03:06.862773 7031 consensus_queue.cc:237] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } }
I20260811 07:03:06.877933 5531 catalog_manager.cc:5495] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "ac7beecf786e4d70a39dafbea5f45365" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } health_report { overall_health: HEALTHY } } }
W20260811 07:03:06.906162 6978 tablet.cc:2369] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:03:06.938023 6821 tablet.cc:2369] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:03:06.941936 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:06.932517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34494 (local address 127.30.73.67:45965)
0811 07:03:06.933242 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:06.933247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:06.933264 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:03:06.933383 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:06.933387 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:06.933708 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:06.933996 (+ 288us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:06.934462 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.935254 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.936705 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:06.937146 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:06.937291 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:06.938319 (+ 1028us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:06.939592 (+ 1273us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:06.939816 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:06.941160 (+ 1344us) server_negotiation.cc:299] Negotiation successful
0811 07:03:06.941285 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585}
I20260811 07:03:06.958299 6602 raft_consensus.cc:1261] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 1 FOLLOWER]: Refusing update from remote peer ac7beecf786e4d70a39dafbea5f45365: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:06.958611 6767 raft_consensus.cc:1261] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 1 FOLLOWER]: Refusing update from remote peer ac7beecf786e4d70a39dafbea5f45365: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:06.959683 7032 consensus_queue.cc:1035] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:06.960126 7031 consensus_queue.cc:1035] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:06.978672 7035 mvcc.cc:205] Tried to move back new op lower bound from 7317224599361077248 to 7317224599007563776. Current Snapshot: MvccSnapshot[applied={T|T < 7317224599361077248}]
I20260811 07:03:07.017546 5532 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:07.017941 5532 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:07.036034 5532 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 921f08041d074ff5ad589360142f632c: Sending DeleteTablet for 3 replicas of tablet 9429470e3d9e43c1b92c85e0c2689160
I20260811 07:03:07.038300 6580 tablet_service.cc:1514] Processing DeleteTablet for tablet 9429470e3d9e43c1b92c85e0c2689160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:07 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:59024
I20260811 07:03:07.039507 6744 tablet_service.cc:1514] Processing DeleteTablet for tablet 9429470e3d9e43c1b92c85e0c2689160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:07 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:57124
I20260811 07:03:07.039943 6902 tablet_service.cc:1514] Processing DeleteTablet for tablet 9429470e3d9e43c1b92c85e0c2689160 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:07 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:34478
I20260811 07:03:07.057390 7053 tablet_replica.cc:330] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: stopping tablet replica
I20260811 07:03:07.058467 7053 raft_consensus.cc:2229] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:03:07.059366 7053 raft_consensus.cc:2258] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:07.060492 7051 tablet_replica.cc:330] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: stopping tablet replica
I20260811 07:03:07.061477 7051 raft_consensus.cc:2229] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:07.063423 7051 raft_consensus.cc:2258] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:07.073690 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 5495
I20260811 07:03:07.074611 7048 tablet_replica.cc:330] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: stopping tablet replica
I20260811 07:03:07.075240 7048 raft_consensus.cc:2229] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:07.075950 7048 raft_consensus.cc:2258] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:07.080358 5565 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:07.063426 7053 ts_tablet_manager.cc:1905] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:07.098839 7051 ts_tablet_manager.cc:1905] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:07.095894 7048 ts_tablet_manager.cc:1905] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:07.114214 7052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:07.040111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60750 (local address 127.30.73.125:42817)
0811 07:03:07.061002 (+ 20891us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:07.061009 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:07.062469 (+ 1460us) server_negotiation.cc:407] Connection header received
0811 07:03:07.062552 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:07.062558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:07.062671 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:07.062786 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:07.076879 (+ 14093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:07.078189 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:07.081780 (+ 3591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:07.082512 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:07.082628 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:07.097930 (+ 15302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:07.097939 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:07.097944 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:07.098000 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:07.102254 (+ 4254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:07.103380 (+ 1126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:07.103386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:07.103390 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:07.103977 (+ 587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:07.106325 (+ 2348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:07.106334 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:07.106338 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:07.107330 (+ 992us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:07.107987 (+ 657us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:07.112841 (+ 4854us) server_negotiation.cc:299] Negotiation successful
0811 07:03:07.113295 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20744,"thread_start_us":20624,"threads_started":1}
I20260811 07:03:07.124635 7048 ts_tablet_manager.cc:1918] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:07.125214 7048 log.cc:1196] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/9429470e3d9e43c1b92c85e0c2689160
I20260811 07:03:07.126794 7048 ts_tablet_manager.cc:1939] T 9429470e3d9e43c1b92c85e0c2689160 P 6005d096eb434aaf9971fd63efd0bd14: Deleting consensus metadata
I20260811 07:03:07.136322 7053 ts_tablet_manager.cc:1918] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:07.136613 7053 log.cc:1196] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/9429470e3d9e43c1b92c85e0c2689160
I20260811 07:03:07.137473 7051 ts_tablet_manager.cc:1918] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:07.137677 7051 log.cc:1196] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/9429470e3d9e43c1b92c85e0c2689160
I20260811 07:03:07.138392 7051 ts_tablet_manager.cc:1939] T 9429470e3d9e43c1b92c85e0c2689160 P 4e49822ff2da420088e926ebb5f3d78e: Deleting consensus metadata
I20260811 07:03:07.147787 7053 ts_tablet_manager.cc:1939] T 9429470e3d9e43c1b92c85e0c2689160 P ac7beecf786e4d70a39dafbea5f45365: Deleting consensus metadata
I20260811 07:03:07.151487 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:07.069958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59164 (local address 127.30.73.124:38219)
0811 07:03:07.095073 (+ 25115us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:07.095081 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:07.116647 (+ 21566us) server_negotiation.cc:407] Connection header received
0811 07:03:07.116957 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:07.116963 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:07.117063 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:07.117163 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:07.119631 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:07.120873 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:07.123432 (+ 2559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:07.125596 (+ 2164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:07.125848 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:07.137560 (+ 11712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:07.137568 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:07.137574 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:07.137647 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:07.141961 (+ 4314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:07.143106 (+ 1145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:07.143115 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:07.143119 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:07.143757 (+ 638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:07.147179 (+ 3422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:07.147189 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:07.147197 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:07.147976 (+ 779us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:07.148325 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:07.150343 (+ 2018us) server_negotiation.cc:299] Negotiation successful
0811 07:03:07.150852 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24895,"thread_start_us":24057,"threads_started":1}
I20260811 07:03:07.322902 5518 catalog_manager.cc:4841] TS ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67:45965): tablet 9429470e3d9e43c1b92c85e0c2689160 (table test-table [id=83f46a58de134daaba0c0e06db23a7e2]) successfully deleted
I20260811 07:03:07.323376 5518 catalog_manager.cc:4841] TS 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875): tablet 9429470e3d9e43c1b92c85e0c2689160 (table test-table [id=83f46a58de134daaba0c0e06db23a7e2]) successfully deleted
I20260811 07:03:07.323704 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 5495
I20260811 07:03:07.480628 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:07.414612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59176 (local address 127.30.73.124:38219)
0811 07:03:07.414929 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:07.414941 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:07.433965 (+ 19024us) server_negotiation.cc:407] Connection header received
0811 07:03:07.434360 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:07.434368 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:07.434467 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:07.434549 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:07.437341 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:07.438653 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:07.440841 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:07.441550 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:07.441680 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:07.461965 (+ 20285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:07.461974 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:07.461979 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:07.462033 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:07.474272 (+ 12239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:07.476016 (+ 1744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:07.476024 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:07.476031 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:07.476252 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:07.476800 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:07.476806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:07.476810 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:07.477410 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:07.477759 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:07.479844 (+ 2085us) server_negotiation.cc:299] Negotiation successful
0811 07:03:07.480233 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 07:03:07.501678 7052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:07.402947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60758 (local address 127.30.73.125:42817)
0811 07:03:07.403237 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:07.403248 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:07.423163 (+ 19915us) server_negotiation.cc:407] Connection header received
0811 07:03:07.435553 (+ 12390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:07.435560 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:07.435653 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:07.435745 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:07.446242 (+ 10497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:07.447614 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:07.455646 (+ 8032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:07.456433 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:07.456564 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:07.483018 (+ 26454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:07.483026 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:07.483032 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:07.483085 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:07.495703 (+ 12618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:07.497154 (+ 1451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:07.497161 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:07.497165 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:07.497485 (+ 320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:07.498010 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:07.498016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:07.498091 (+ 75us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:07.498548 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:07.498875 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:07.500341 (+ 1466us) server_negotiation.cc:299] Negotiation successful
0811 07:03:07.501020 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:03:07.997784 7064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:07.996494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.67:41529)
0811 07:03:07.997241 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:07.997414 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":481,"threads_started":1}
W20260811 07:03:07.998624 6976 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:44089 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
I20260811 07:03:08.000212 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:07.998895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.66:39539)
0811 07:03:07.999679 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:07.999936 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":315,"threads_started":1}
W20260811 07:03:08.000733 6819 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:44089 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
I20260811 07:03:08.002321 7068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.001432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.65:50557)
0811 07:03:08.001954 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.002092 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":576,"threads_started":1}
W20260811 07:03:08.002803 6651 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:44089 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
I20260811 07:03:08.537358 7069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 921f08041d074ff5ad589360142f632c)
I20260811 07:03:08.537376 7070 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 921f08041d074ff5ad589360142f632c)
I20260811 07:03:08.537685 7070 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } }
I20260811 07:03:08.537672 7069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } }
I20260811 07:03:08.539155 7069 leader_election.cc:288] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 921f08041d074ff5ad589360142f632c (127.30.73.126:44089), d1b094721a2d4adb840c9d570fae44a8 (127.30.73.124:38219)
I20260811 07:03:08.539156 7070 leader_election.cc:288] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 921f08041d074ff5ad589360142f632c (127.30.73.126:44089), 3abef8dfca024f7e88d757bbb3d399fe (127.30.73.125:42817)
I20260811 07:03:08.540853 7071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.539315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40716)
0811 07:03:08.540307 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.540529 (+ 222us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":860,"thread_start_us":707,"threads_started":1}
I20260811 07:03:08.541949 7073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.539676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40730)
0811 07:03:08.540790 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.540970 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":900,"thread_start_us":751,"threads_started":1}
W20260811 07:03:08.542259 6203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
W20260811 07:03:08.542404 6431 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
I20260811 07:03:08.555938 7073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.555420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40748)
0811 07:03:08.555617 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.555709 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 07:03:08.556137 7074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.554705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40746)
0811 07:03:08.555325 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.555833 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260811 07:03:08.556433 6203 leader_election.cc:334] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 921f08041d074ff5ad589360142f632c (127.30.73.126:44089): Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
W20260811 07:03:08.556511 6431 leader_election.cc:334] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 921f08041d074ff5ad589360142f632c (127.30.73.126:44089): Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
I20260811 07:03:08.560196 7075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.541691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60760 (local address 127.30.73.125:42817)
0811 07:03:08.543126 (+ 1435us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:08.543136 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:08.543164 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:03:08.543251 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:08.543259 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:08.543360 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:08.544538 (+ 1178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:08.546026 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.549007 (+ 2981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.556259 (+ 7252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.558440 (+ 2181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.558626 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.558781 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:08.559380 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 07:03:08.559785 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1268,"thread_start_us":304,"threads_started":1}
I20260811 07:03:08.560981 7072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.539383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:42817 (local address 127.0.0.1:60760)
0811 07:03:08.540029 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.540060 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:08.540208 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:08.543602 (+ 3394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:08.543611 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:08.543652 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:08.544183 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.544200 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.549324 (+ 5124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.549335 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.555296 (+ 5961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.555318 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.558643 (+ 3325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.558650 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.558860 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.558888 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:03:08.559324 (+ 436us) client_negotiation.cc:240] Negotiation successful
0811 07:03:08.559775 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"mutex_wait_us":118,"thread_start_us":333,"threads_started":1}
I20260811 07:03:08.561908 6231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d1b094721a2d4adb840c9d570fae44a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3abef8dfca024f7e88d757bbb3d399fe" is_pre_election: true
I20260811 07:03:08.562243 6231 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1b094721a2d4adb840c9d570fae44a8 in term 1.
I20260811 07:03:08.563898 6434 leader_election.cc:302] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3abef8dfca024f7e88d757bbb3d399fe, d1b094721a2d4adb840c9d570fae44a8; no voters: 921f08041d074ff5ad589360142f632c
I20260811 07:03:08.564121 7071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.540521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:38219 (local address 127.0.0.1:59178)
0811 07:03:08.541065 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.541082 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:08.541212 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:08.555101 (+ 13889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:08.555112 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:08.555339 (+ 227us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:08.556067 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.556094 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.557625 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.557629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.559095 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.559108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.562577 (+ 3469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.562584 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.562764 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.562791 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:03:08.562879 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:03:08.562998 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":958,"threads_started":1}
I20260811 07:03:08.564275 7076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.541612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59178 (local address 127.30.73.124:38219)
0811 07:03:08.553316 (+ 11704us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:08.553326 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:08.553361 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:03:08.553471 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:08.553480 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:08.553807 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:08.555690 (+ 1883us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:08.556325 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.557397 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.559271 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.561440 (+ 2169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.561616 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.561735 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:08.563725 (+ 1990us) server_negotiation.cc:299] Negotiation successful
0811 07:03:08.563912 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11438,"thread_start_us":11176,"threads_started":1}
I20260811 07:03:08.565394 7070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 07:03:08.565555 7070 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 921f08041d074ff5ad589360142f632c)
I20260811 07:03:08.565689 7070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:03:08.565845 6463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3abef8dfca024f7e88d757bbb3d399fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d1b094721a2d4adb840c9d570fae44a8" is_pre_election: true
I20260811 07:03:08.568531 7070 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } }
I20260811 07:03:08.574441 6463 raft_consensus.cc:2379] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3abef8dfca024f7e88d757bbb3d399fe in current term 2: Already voted for candidate d1b094721a2d4adb840c9d570fae44a8 in this term.
I20260811 07:03:08.574877 7070 leader_election.cc:288] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [CANDIDATE]: Term 2 election: Requested vote from peers 921f08041d074ff5ad589360142f632c (127.30.73.126:44089), 3abef8dfca024f7e88d757bbb3d399fe (127.30.73.125:42817)
I20260811 07:03:08.575641 6231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d1b094721a2d4adb840c9d570fae44a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3abef8dfca024f7e88d757bbb3d399fe"
I20260811 07:03:08.575842 6203 leader_election.cc:302] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3abef8dfca024f7e88d757bbb3d399fe; no voters: 921f08041d074ff5ad589360142f632c, d1b094721a2d4adb840c9d570fae44a8
I20260811 07:03:08.575923 7072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.575160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40760)
0811 07:03:08.575368 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.575739 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 07:03:08.575944 6231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:03:08.577940 7072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.577041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40788)
0811 07:03:08.577263 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.577671 (+ 408us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
W20260811 07:03:08.578226 6431 leader_election.cc:334] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 921f08041d074ff5ad589360142f632c (127.30.73.126:44089): Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
I20260811 07:03:08.579780 6231 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1b094721a2d4adb840c9d570fae44a8 in term 2.
I20260811 07:03:08.580404 7069 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:03:08.580358 6434 leader_election.cc:302] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3abef8dfca024f7e88d757bbb3d399fe, d1b094721a2d4adb840c9d570fae44a8; no voters: 921f08041d074ff5ad589360142f632c
I20260811 07:03:08.580849 7070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:03:08.581445 7070 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [term 2 LEADER]: Becoming Leader. State: Replica: d1b094721a2d4adb840c9d570fae44a8, State: Running, Role: LEADER
I20260811 07:03:08.581949 7070 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } }
I20260811 07:03:08.584573 7080 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1b094721a2d4adb840c9d570fae44a8. Latest consensus state: current_term: 2 leader_uuid: "d1b094721a2d4adb840c9d570fae44a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:08.590761 7080 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:08.594750 7082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:03:08.602950 7082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:03:08.604604 7082 catalog_manager.cc:1259] Loaded cluster ID: 5fcc663ca6cb488da94262d01760ee58
I20260811 07:03:08.604739 7082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:03:08.606084 7082 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:03:08.606948 7082 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Loaded TSK: 0
I20260811 07:03:08.607986 7082 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:03:08.639540 6449 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:03:08.655956 6449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:03:08.663559 7072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.662870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40818)
0811 07:03:08.663218 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.663354 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201}
I20260811 07:03:08.663573 6231 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [term 2 FOLLOWER]: Refusing update from remote peer d1b094721a2d4adb840c9d570fae44a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 07:03:08.664747 7080 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 07:03:08.664992 7072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.664549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40824)
0811 07:03:08.664756 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.664831 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 07:03:08.665206 6431 consensus_peers.cc:487] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 -> Peer 921f08041d074ff5ad589360142f632c (127.30.73.126:44089): Couldn't send request to peer 921f08041d074ff5ad589360142f632c. Status: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 07:03:08.674619 7069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1b094721a2d4adb840c9d570fae44a8. Latest consensus state: current_term: 2 leader_uuid: "d1b094721a2d4adb840c9d570fae44a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:08.674994 7069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:03:08.678799 7080 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "d1b094721a2d4adb840c9d570fae44a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:08.679185 7080 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:08.679522 7084 mvcc.cc:205] Tried to move back new op lower bound from 7317224606355128320 to 7317224606035742720. Current Snapshot: MvccSnapshot[applied={T|T < 7317224606355128320}]
I20260811 07:03:08.681028 7069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "d1b094721a2d4adb840c9d570fae44a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "921f08041d074ff5ad589360142f632c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44089 } } peers { permanent_uuid: "3abef8dfca024f7e88d757bbb3d399fe" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 42817 } attrs { promote: false } } peers { permanent_uuid: "d1b094721a2d4adb840c9d570fae44a8" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 38219 } attrs { promote: false } } }
I20260811 07:03:08.681735 7069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abef8dfca024f7e88d757bbb3d399fe [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:03:08.719614 7072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.703885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39875 (local address 127.0.0.1:57138)
0811 07:03:08.704066 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.704089 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:08.704249 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:08.712551 (+ 8302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:08.712556 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:08.712589 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:08.712842 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.712855 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.715021 (+ 2166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.715029 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.716664 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.716685 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.718729 (+ 2044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.718737 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.718944 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.718987 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 07:03:08.719073 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 07:03:08.719254 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 07:03:08.720976 7089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.702458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57138 (local address 127.30.73.66:39875)
0811 07:03:08.704069 (+ 1611us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:08.704077 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:08.704186 (+ 109us) server_negotiation.cc:407] Connection header received
0811 07:03:08.711161 (+ 6975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:08.711981 (+ 820us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:08.712160 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:08.713016 (+ 856us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:08.713252 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.714802 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.716943 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.718360 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.720203 (+ 1843us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.720360 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:08.720421 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 07:03:08.720584 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1472,"thread_start_us":1351,"threads_started":1}
I20260811 07:03:08.723912 6744 tablet_service.cc:1467] Processing CreateTablet for tablet db2b10b737c1444989823f880be9928e (DEFAULT_TABLE table=test-table [id=8c85ccd0096a4ed7b31dc4b92e2df6de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:08.725109 6744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db2b10b737c1444989823f880be9928e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:08.736049 7090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.705500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34506 (local address 127.30.73.67:45965)
0811 07:03:08.718976 (+ 13476us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:08.718984 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:08.719008 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:03:08.719095 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:08.719101 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:08.719187 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:08.720163 (+ 976us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:08.720578 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.721927 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.730792 (+ 8865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.732242 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.732412 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.732540 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:08.733669 (+ 1129us) server_negotiation.cc:299] Negotiation successful
0811 07:03:08.733909 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13318,"thread_start_us":13252,"threads_started":1}
I20260811 07:03:08.737085 7073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.705119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:45965 (local address 127.0.0.1:34506)
0811 07:03:08.711955 (+ 6836us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.712034 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:08.712383 (+ 349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:08.719366 (+ 6983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:08.719372 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:08.719404 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:08.719930 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.719947 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.722175 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.722181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.729681 (+ 7500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.729703 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.732800 (+ 3097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.732810 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.733009 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.733047 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:03:08.733166 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 07:03:08.733410 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3251,"mutex_wait_us":1}
I20260811 07:03:08.737867 7091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.705553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:34877 (local address 127.0.0.1:59034)
0811 07:03:08.714377 (+ 8824us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.714660 (+ 283us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:08.714816 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:08.722785 (+ 7969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:08.722792 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:08.722824 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:08.727831 (+ 5007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.727849 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.729480 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.729491 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.732647 (+ 3156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:08.732666 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.736842 (+ 4176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.736858 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:08.737040 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.737075 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 07:03:08.737145 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 07:03:08.737524 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8542,"thread_start_us":8464,"threads_started":1}
I20260811 07:03:08.738420 7093 tablet_bootstrap.cc:492] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: Bootstrap starting.
I20260811 07:03:08.738376 6902 tablet_service.cc:1467] Processing CreateTablet for tablet db2b10b737c1444989823f880be9928e (DEFAULT_TABLE table=test-table [id=8c85ccd0096a4ed7b31dc4b92e2df6de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:08.738942 6902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db2b10b737c1444989823f880be9928e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:08.739009 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.705960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59034 (local address 127.30.73.65:34877)
0811 07:03:08.722399 (+ 16439us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:08.722406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:08.722429 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:03:08.722509 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:08.722515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:08.722601 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:08.722895 (+ 294us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:08.728114 (+ 5219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.729288 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.732868 (+ 3580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:08.734624 (+ 1756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:08.738263 (+ 3639us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:08.738407 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:08.738476 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 07:03:08.738643 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16249,"thread_start_us":17803,"threads_started":1}
I20260811 07:03:08.740125 7093 tablet_bootstrap.cc:654] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:08.741487 6580 tablet_service.cc:1467] Processing CreateTablet for tablet db2b10b737c1444989823f880be9928e (DEFAULT_TABLE table=test-table [id=8c85ccd0096a4ed7b31dc4b92e2df6de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:08.741981 6580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db2b10b737c1444989823f880be9928e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:08.744572 7093 tablet_bootstrap.cc:492] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: No bootstrap required, opened a new log
I20260811 07:03:08.744761 7093 ts_tablet_manager.cc:1397] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 07:03:08.745651 7093 raft_consensus.cc:348] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } }
I20260811 07:03:08.745959 7093 raft_consensus.cc:374] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:08.746078 7093 raft_consensus.cc:729] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e49822ff2da420088e926ebb5f3d78e, State: Initialized, Role: FOLLOWER
I20260811 07:03:08.746373 7093 consensus_queue.cc:260] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } }
I20260811 07:03:08.759802 7096 tablet_bootstrap.cc:492] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: Bootstrap starting.
I20260811 07:03:08.761092 7097 tablet_bootstrap.cc:492] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: Bootstrap starting.
I20260811 07:03:08.764389 7093 ts_tablet_manager.cc:1428] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: Time spent starting tablet: real 0.019s user 0.004s sys 0.013s
I20260811 07:03:08.766539 7097 tablet_bootstrap.cc:654] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:08.763445 7096 tablet_bootstrap.cc:654] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:08.774019 6818 heartbeater.cc:503] Master 127.30.73.124:38219 was elected leader, sending a full tablet report...
I20260811 07:03:08.776418 7098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.766464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.66:34351)
0811 07:03:08.775733 (+ 9269us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.775976 (+ 243us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9018,"thread_start_us":4753,"threads_started":1}
I20260811 07:03:08.778333 7098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.777886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.66:56659)
0811 07:03:08.778045 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.778177 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 07:03:08.778543 7097 tablet_bootstrap.cc:492] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: No bootstrap required, opened a new log
I20260811 07:03:08.778703 7096 tablet_bootstrap.cc:492] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: No bootstrap required, opened a new log
I20260811 07:03:08.778755 7097 ts_tablet_manager.cc:1397] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20260811 07:03:08.778868 7096 ts_tablet_manager.cc:1397] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.004s
I20260811 07:03:08.779670 7096 raft_consensus.cc:348] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } }
I20260811 07:03:08.779935 7096 raft_consensus.cc:374] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:08.779772 7097 raft_consensus.cc:348] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } }
I20260811 07:03:08.780046 7097 raft_consensus.cc:374] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:08.780049 7096 raft_consensus.cc:729] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac7beecf786e4d70a39dafbea5f45365, State: Initialized, Role: FOLLOWER
I20260811 07:03:08.780161 7097 raft_consensus.cc:729] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6005d096eb434aaf9971fd63efd0bd14, State: Initialized, Role: FOLLOWER
I20260811 07:03:08.780354 7096 consensus_queue.cc:260] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } }
I20260811 07:03:08.780462 7097 consensus_queue.cc:260] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } }
I20260811 07:03:08.786844 7096 ts_tablet_manager.cc:1428] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20260811 07:03:08.797258 7097 ts_tablet_manager.cc:1428] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: Time spent starting tablet: real 0.018s user 0.007s sys 0.011s
I20260811 07:03:08.797847 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.787037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.67:49219)
0811 07:03:08.797082 (+ 10045us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.797395 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9868,"thread_start_us":9574,"threads_started":1}
I20260811 07:03:08.801129 6975 heartbeater.cc:503] Master 127.30.73.124:38219 was elected leader, sending a full tablet report...
I20260811 07:03:08.804816 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.803245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.65:39985)
0811 07:03:08.804366 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.804509 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":979,"thread_start_us":845,"threads_started":1}
I20260811 07:03:08.806254 6650 heartbeater.cc:503] Master 127.30.73.124:38219 was elected leader, sending a full tablet report...
I20260811 07:03:08.806254 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.805850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.65:51219)
0811 07:03:08.806008 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.806094 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 07:03:08.807731 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:08.803438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.67:37103)
0811 07:03:08.803644 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:08.807549 (+ 3905us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 07:03:09.077807 7091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.077182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40826)
0811 07:03:09.077490 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.077575 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260811 07:03:09.079133 7091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.078618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:40834)
0811 07:03:09.078875 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.078970 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260811 07:03:09.079612 7103 raft_consensus.cc:482] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:03:09.079957 7103 raft_consensus.cc:504] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } }
I20260811 07:03:09.080924 7103 leader_election.cc:288] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875), ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67:45965)
I20260811 07:03:09.081844 6767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db2b10b737c1444989823f880be9928e" candidate_uuid: "6005d096eb434aaf9971fd63efd0bd14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e49822ff2da420088e926ebb5f3d78e" is_pre_election: true
I20260811 07:03:09.082062 6926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db2b10b737c1444989823f880be9928e" candidate_uuid: "6005d096eb434aaf9971fd63efd0bd14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac7beecf786e4d70a39dafbea5f45365" is_pre_election: true
I20260811 07:03:09.082156 6767 raft_consensus.cc:2454] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6005d096eb434aaf9971fd63efd0bd14 in term 0.
I20260811 07:03:09.082365 6926 raft_consensus.cc:2454] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6005d096eb434aaf9971fd63efd0bd14 in term 0.
I20260811 07:03:09.082883 6530 leader_election.cc:302] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6005d096eb434aaf9971fd63efd0bd14, ac7beecf786e4d70a39dafbea5f45365; no voters:
I20260811 07:03:09.083195 7103 raft_consensus.cc:2781] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:03:09.083329 7103 raft_consensus.cc:482] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:03:09.083441 7103 raft_consensus.cc:3037] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:09.093860 7103 raft_consensus.cc:504] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } }
I20260811 07:03:09.094955 7103 leader_election.cc:288] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [CANDIDATE]: Term 1 election: Requested vote from peers 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875), ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67:45965)
I20260811 07:03:09.095849 6926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db2b10b737c1444989823f880be9928e" candidate_uuid: "6005d096eb434aaf9971fd63efd0bd14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac7beecf786e4d70a39dafbea5f45365"
I20260811 07:03:09.095849 6767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db2b10b737c1444989823f880be9928e" candidate_uuid: "6005d096eb434aaf9971fd63efd0bd14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e49822ff2da420088e926ebb5f3d78e"
I20260811 07:03:09.096104 6767 raft_consensus.cc:3037] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:09.096109 6926 raft_consensus.cc:3037] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:09.099540 6926 raft_consensus.cc:2454] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6005d096eb434aaf9971fd63efd0bd14 in term 1.
I20260811 07:03:09.099540 6767 raft_consensus.cc:2454] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6005d096eb434aaf9971fd63efd0bd14 in term 1.
I20260811 07:03:09.100090 6530 leader_election.cc:302] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e49822ff2da420088e926ebb5f3d78e, 6005d096eb434aaf9971fd63efd0bd14; no voters:
I20260811 07:03:09.100497 7103 raft_consensus.cc:2781] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:09.101094 7103 raft_consensus.cc:686] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 1 LEADER]: Becoming Leader. State: Replica: 6005d096eb434aaf9971fd63efd0bd14, State: Running, Role: LEADER
I20260811 07:03:09.101549 7103 consensus_queue.cc:237] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } }
I20260811 07:03:09.102883 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.102345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.65:56385)
0811 07:03:09.102548 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.102655 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 07:03:09.115950 6449 catalog_manager.cc:5495] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6005d096eb434aaf9971fd63efd0bd14 (127.30.73.65). New cstate: current_term: 1 leader_uuid: "6005d096eb434aaf9971fd63efd0bd14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6005d096eb434aaf9971fd63efd0bd14" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 34877 } health_report { overall_health: HEALTHY } } }
I20260811 07:03:09.207172 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.199267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33512 (local address 127.30.73.65:34877)
0811 07:03:09.199481 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:09.199490 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:09.199897 (+ 407us) server_negotiation.cc:407] Connection header received
0811 07:03:09.200188 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:09.200193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:09.200296 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:09.200440 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:09.200878 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:09.201635 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:09.203302 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:09.204209 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:09.204343 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:09.205160 (+ 817us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:09.206126 (+ 966us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:09.206677 (+ 551us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:09.206751 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 07:03:09.206875 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:03:09.214934 6767 raft_consensus.cc:1261] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [term 1 FOLLOWER]: Refusing update from remote peer 6005d096eb434aaf9971fd63efd0bd14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:09.215092 6926 raft_consensus.cc:1261] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [term 1 FOLLOWER]: Refusing update from remote peer 6005d096eb434aaf9971fd63efd0bd14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:09.216023 7107 consensus_queue.cc:1035] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e49822ff2da420088e926ebb5f3d78e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:09.216593 7103 consensus_queue.cc:1035] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac7beecf786e4d70a39dafbea5f45365" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:09.219475 7098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.218826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.66:51473)
0811 07:03:09.219098 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.219238 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260811 07:03:09.221045 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.220326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.67:49661)
0811 07:03:09.220617 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.220768 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260811 07:03:09.225205 7112 mvcc.cc:205] Tried to move back new op lower bound from 7317224608612159488 to 7317224608164737024. Current Snapshot: MvccSnapshot[applied={T|T < 7317224608612159488}]
I20260811 07:03:09.227546 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.226781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.65:52623)
0811 07:03:09.227142 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.227285 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199}
I20260811 07:03:09.231101 7098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.229687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.66:51331)
0811 07:03:09.230151 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.230290 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260}
I20260811 07:03:09.241091 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.240306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.65:38573)
0811 07:03:09.240639 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.240791 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203}
I20260811 07:03:09.243129 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.242082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.30.73.67:56045)
0811 07:03:09.242732 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.242876 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408}
I20260811 07:03:09.243271 6449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:09.243566 6449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:09.262727 6449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d1b094721a2d4adb840c9d570fae44a8: Sending DeleteTablet for 3 replicas of tablet db2b10b737c1444989823f880be9928e
I20260811 07:03:09.266166 6580 tablet_service.cc:1514] Processing DeleteTablet for tablet db2b10b737c1444989823f880be9928e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:09 UTC) from {username='oryx', principal='oryx/127.30.73.124@KRBTEST.COM'} at 127.0.0.1:59034
I20260811 07:03:09.266285 6744 tablet_service.cc:1514] Processing DeleteTablet for tablet db2b10b737c1444989823f880be9928e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:09 UTC) from {username='oryx', principal='oryx/127.30.73.124@KRBTEST.COM'} at 127.0.0.1:57138
I20260811 07:03:09.266417 6743 tablet_service.cc:1514] Processing DeleteTablet for tablet db2b10b737c1444989823f880be9928e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:09 UTC) from {username='oryx', principal='oryx/127.30.73.124@KRBTEST.COM'} at 127.0.0.1:57138
I20260811 07:03:09.268523 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 6417
I20260811 07:03:09.269392 6902 tablet_service.cc:1514] Processing DeleteTablet for tablet db2b10b737c1444989823f880be9928e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:09 UTC) from {username='oryx', principal='oryx/127.30.73.124@KRBTEST.COM'} at 127.0.0.1:34506
I20260811 07:03:09.278847 7125 tablet_replica.cc:330] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: stopping tablet replica
I20260811 07:03:09.279197 7125 raft_consensus.cc:2229] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:09.281021 7123 tablet_replica.cc:330] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: stopping tablet replica
I20260811 07:03:09.281301 7123 raft_consensus.cc:2229] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:03:09.282356 7125 raft_consensus.cc:2258] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:09.282984 7121 tablet_replica.cc:330] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: stopping tablet replica
I20260811 07:03:09.283226 7121 raft_consensus.cc:2229] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:09.283519 7121 raft_consensus.cc:2258] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:09.288401 7123 raft_consensus.cc:2258] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:09.292910 7125 ts_tablet_manager.cc:1905] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:09.295028 7123 ts_tablet_manager.cc:1905] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:09.296938 7121 ts_tablet_manager.cc:1905] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:09.303617 7125 ts_tablet_manager.cc:1918] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:09.304075 7125 log.cc:1196] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/db2b10b737c1444989823f880be9928e
I20260811 07:03:09.304754 7123 ts_tablet_manager.cc:1918] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:09.304920 7123 log.cc:1196] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/db2b10b737c1444989823f880be9928e
I20260811 07:03:09.306867 7125 ts_tablet_manager.cc:1939] T db2b10b737c1444989823f880be9928e P ac7beecf786e4d70a39dafbea5f45365: Deleting consensus metadata
I20260811 07:03:09.307185 7123 ts_tablet_manager.cc:1939] T db2b10b737c1444989823f880be9928e P 6005d096eb434aaf9971fd63efd0bd14: Deleting consensus metadata
I20260811 07:03:09.313489 6434 catalog_manager.cc:4841] TS ac7beecf786e4d70a39dafbea5f45365 (127.30.73.67:45965): tablet db2b10b737c1444989823f880be9928e (table test-table [id=8c85ccd0096a4ed7b31dc4b92e2df6de]) successfully deleted
I20260811 07:03:09.314981 6434 catalog_manager.cc:4841] TS 6005d096eb434aaf9971fd63efd0bd14 (127.30.73.65:34877): tablet db2b10b737c1444989823f880be9928e (table test-table [id=8c85ccd0096a4ed7b31dc4b92e2df6de]) successfully deleted
I20260811 07:03:09.321089 7121 ts_tablet_manager.cc:1918] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:09.321339 7121 log.cc:1196] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/db2b10b737c1444989823f880be9928e
I20260811 07:03:09.321787 7121 ts_tablet_manager.cc:1939] T db2b10b737c1444989823f880be9928e P 4e49822ff2da420088e926ebb5f3d78e: Deleting consensus metadata
I20260811 07:03:09.323525 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.270467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33516 (local address 127.30.73.65:34877)
0811 07:03:09.270684 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:09.270691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:09.280360 (+ 9669us) server_negotiation.cc:407] Connection header received
0811 07:03:09.282647 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:09.282656 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:09.282772 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:09.282911 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:09.290932 (+ 8021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:09.293963 (+ 3031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:09.296209 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:09.296918 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:09.297134 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:09.311811 (+ 14677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:09.311841 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:09.311867 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:09.311939 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:09.318998 (+ 7059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:09.320254 (+ 1256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:09.320266 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:09.320269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:09.320512 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:09.321243 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:09.321248 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:09.321252 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:09.321779 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:09.322226 (+ 447us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:09.322799 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 07:03:09.323082 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:03:09.326947 6434 catalog_manager.cc:4841] TS 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875): tablet db2b10b737c1444989823f880be9928e (table test-table [id=8c85ccd0096a4ed7b31dc4b92e2df6de]) successfully deleted
W20260811 07:03:09.334512 6434 catalog_manager.cc:4808] TS 4e49822ff2da420088e926ebb5f3d78e (127.30.73.66:39875): delete failed for tablet db2b10b737c1444989823f880be9928e because the tablet was not found. No further retry: Not found: Tablet not found: db2b10b737c1444989823f880be9928e
I20260811 07:03:09.335026 6645 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:09.539701 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 6417
I20260811 07:03:09.581050 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 6663
I20260811 07:03:09.614145 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.582057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40354 (local address 127.30.73.66:39875)
0811 07:03:09.582639 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:09.582647 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:09.582678 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:03:09.582741 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:09.582745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:09.582815 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:09.582909 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:09.588893 (+ 5984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:09.589687 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:09.593370 (+ 3683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:09.594176 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:09.594321 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:09.598986 (+ 4665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:09.599006 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:09.599025 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:09.599072 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:09.603049 (+ 3977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:09.607712 (+ 4663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:09.607724 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:09.607727 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:09.607960 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:09.608678 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:09.608682 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:09.608685 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:09.609115 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:09.609524 (+ 409us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:09.612914 (+ 3390us) server_negotiation.cc:299] Negotiation successful
0811 07:03:09.613275 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":285,"threads_started":1}
I20260811 07:03:09.615185 6812 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:09.657793 7130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.656992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:55762)
0811 07:03:09.657508 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.657607 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":294,"threads_started":1}
I20260811 07:03:09.659597 7130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.659215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:55764)
0811 07:03:09.659374 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:09.659472 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 07:03:09.779671 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 6663
I20260811 07:03:09.814127 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 6833
I20260811 07:03:09.840809 7132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:09.815140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49622 (local address 127.30.73.67:45965)
0811 07:03:09.815726 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:09.815731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:09.815749 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:03:09.815810 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:09.815814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:09.815884 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:09.815984 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:09.818138 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:09.818885 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:09.820579 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:09.821131 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:09.821240 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:09.827088 (+ 5848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:09.827118 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:09.827145 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:09.827840 (+ 695us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:09.837101 (+ 9261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:09.838474 (+ 1373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:09.838483 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:09.838486 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:09.838667 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:09.839146 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:09.839150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:09.839152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:09.839573 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:09.839822 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:09.840257 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 07:03:09.840452 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":385,"threads_started":1}
I20260811 07:03:09.841755 6969 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:10.026369 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 6833
I20260811 07:03:10.097329 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 6064
I20260811 07:03:10.099393 6254 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:10.128129 7130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:10.124378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:55774)
0811 07:03:10.127825 (+ 3447us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:10.127952 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3273}
I20260811 07:03:10.131095 7130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:10.129313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44089 (local address 127.0.0.1:55790)
0811 07:03:10.130557 (+ 1244us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:10.130825 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":715}
I20260811 07:03:10.255534 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 6064
I20260811 07:03:10.286885 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 6180
I20260811 07:03:10.289033 6486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:10.458600 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 6180
2026-08-11T07:03:10Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (12125 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:03:10 dist-test-slave-69rg krb5kdc[7139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:03:10 dist-test-slave-69rg krb5kdc[7139](info): set up 2 sockets
Aug 11 07:03:10 dist-test-slave-69rg krb5kdc[7139](info): commencing operation
krb5kdc: starting...
W20260811 07:03:12.013136 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.486s user 0.003s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:03:12 dist-test-slave-69rg krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:03:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:03:12Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.126.keytab.
Entry for principal oryx/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.126.keytab.
I20260811 07:03:12.423593 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35103
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.126.keytab
--principal=oryx/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:43505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:35103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:12.974253 7156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:12.974725 7156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:12.975284 7156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:12.987820 7156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:12.988032 7156 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:03:12.988090 7156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:12.988201 7156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:12.988288 7156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:12.988395 7156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:13.007625 7156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:43505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:35103
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.126.keytab
--principal=oryx/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:13.010905 7156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:13.013798 7156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:13.041513 7162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:13.041683 7165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:13.041596 7156 server_base.cc:1034] running on GCE node
W20260811 07:03:13.041625 7163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:13.043920 7156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:13.046504 7156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:13.047888 7156 hybrid_clock.cc:648] HybridClock initialized: now 1786431793047807 us; error 52 us; skew 500 ppm
I20260811 07:03:13.048415 7156 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:13 dist-test-slave-69rg krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431793, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:13.063436 7156 init.cc:377] Logged in from keytab as oryx/127.30.73.126@KRBTEST.COM (short username oryx)
I20260811 07:03:13.067588 7156 webserver.cc:460] Webserver started at http://127.30.73.126:41629/ using document root <none> and password file <none>
I20260811 07:03:13.068879 7156 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:13.069092 7156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:13.069599 7156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:13.074163 7156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "732bfe76b4f848e0a5bb21086e7fa922"
format_stamp: "Formatted at 2026-08-11 07:03:13 on dist-test-slave-69rg"
server_key: "3983e9b143acd0359c2b1fc0e5082d79"
server_key_iv: "06d8af4d72515966e6ba951d6cdfc38b"
server_key_version: "encryptionkey@0"
I20260811 07:03:13.075414 7156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "732bfe76b4f848e0a5bb21086e7fa922"
format_stamp: "Formatted at 2026-08-11 07:03:13 on dist-test-slave-69rg"
server_key: "3983e9b143acd0359c2b1fc0e5082d79"
server_key_iv: "06d8af4d72515966e6ba951d6cdfc38b"
server_key_version: "encryptionkey@0"
I20260811 07:03:13.084985 7156 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.006s sys 0.003s
I20260811 07:03:13.091799 7175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:13.094725 7156 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260811 07:03:13.095041 7156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "732bfe76b4f848e0a5bb21086e7fa922"
format_stamp: "Formatted at 2026-08-11 07:03:13 on dist-test-slave-69rg"
server_key: "3983e9b143acd0359c2b1fc0e5082d79"
server_key_iv: "06d8af4d72515966e6ba951d6cdfc38b"
server_key_version: "encryptionkey@0"
I20260811 07:03:13.095392 7156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:13.117339 7156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:13.125365 7156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:13.125944 7156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:13.165505 7156 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:35103
I20260811 07:03:13.165681 7244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:35103 every 8 connection(s)
I20260811 07:03:13.167963 7156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:03:13.171077 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 7156
I20260811 07:03:13.171404 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:03:13.172894 31013 external_mini_cluster.cc:1428] Setting key 13a9c39b6986fa1fb60135eacf220753
I20260811 07:03:13.177444 7245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:03:13 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:13.199648 7245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922: Bootstrap starting.
I20260811 07:03:13.206781 7245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:13.210618 7245 log.cc:824] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:13.215206 7245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922: No bootstrap required, opened a new log
I20260811 07:03:13.218132 7248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:13.176838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42510 (local address 127.30.73.126:35103)
0811 07:03:13.178944 (+ 2106us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:13.178961 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:13.179021 (+ 60us) server_negotiation.cc:407] Connection header received
0811 07:03:13.181376 (+ 2355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:13.181412 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:13.182209 (+ 797us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:13.182726 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:13.186048 (+ 3322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:13.188208 (+ 2160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:13.191156 (+ 2948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:13.192461 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:13.192714 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:13.200985 (+ 8271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:13.201006 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:13.201043 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:13.201128 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:13.209789 (+ 8661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:13.211680 (+ 1891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:13.211691 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:13.211700 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:13.212057 (+ 357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:13.212669 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:13.212678 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:13.212691 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:13.213448 (+ 757us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:13.213947 (+ 499us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:13.214630 (+ 683us) server_negotiation.cc:299] Negotiation successful
0811 07:03:13.215674 (+ 1044us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1630,"thread_start_us":1109,"threads_started":1}
I20260811 07:03:13.228327 7245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732bfe76b4f848e0a5bb21086e7fa922" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35103 } }
I20260811 07:03:13.229416 7245 raft_consensus.cc:374] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:13.229563 7245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 732bfe76b4f848e0a5bb21086e7fa922, State: Initialized, Role: FOLLOWER
I20260811 07:03:13.230665 7245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732bfe76b4f848e0a5bb21086e7fa922" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35103 } }
I20260811 07:03:13.231359 7245 raft_consensus.cc:388] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:03:13.231702 7245 raft_consensus.cc:482] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:03:13.232048 7245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:13.235819 7245 raft_consensus.cc:504] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732bfe76b4f848e0a5bb21086e7fa922" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35103 } }
I20260811 07:03:13.236933 7245 leader_election.cc:302] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 732bfe76b4f848e0a5bb21086e7fa922; no voters:
I20260811 07:03:13.238647 7245 leader_election.cc:288] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:03:13.238863 7250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:13.241067 7250 raft_consensus.cc:686] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [term 1 LEADER]: Becoming Leader. State: Replica: 732bfe76b4f848e0a5bb21086e7fa922, State: Running, Role: LEADER
I20260811 07:03:13.242408 7245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:03:13.242120 7250 consensus_queue.cc:237] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732bfe76b4f848e0a5bb21086e7fa922" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35103 } }
I20260811 07:03:13.249084 7253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 732bfe76b4f848e0a5bb21086e7fa922. Latest consensus state: current_term: 1 leader_uuid: "732bfe76b4f848e0a5bb21086e7fa922" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732bfe76b4f848e0a5bb21086e7fa922" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35103 } } }
I20260811 07:03:13.250197 7253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:13.247941 7251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "732bfe76b4f848e0a5bb21086e7fa922" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732bfe76b4f848e0a5bb21086e7fa922" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35103 } } }
I20260811 07:03:13.251137 7251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:13.259644 7263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:03:13.267779 7263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:03:13.285766 7263 catalog_manager.cc:1347] Generated new cluster ID: 78e89d24bd904e83965e086191b72346
I20260811 07:03:13.286072 7263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:03:13.300235 7263 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:03:13.302373 7263 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:03:13.316284 7263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922: Generated new TSK 0
I20260811 07:03:13.317698 7263 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab.
Entry for principal oryx/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab.
I20260811 07:03:13.428562 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35103
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab
--principal=oryx/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:43505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:13.960242 7277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:13.961017 7277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:13.961169 7277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:13.973448 7277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:13.973616 7277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:13.973731 7277 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:03:13.973850 7277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:03:13.987839 7277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:43505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab
--principal=oryx/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.73.126:35103
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:13.989488 7277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:13.991281 7277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:14.014168 7282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:14.014200 7283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:14.014392 7285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:14.015136 7277 server_base.cc:1034] running on GCE node
I20260811 07:03:14.015862 7277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:14.018617 7277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:14.019932 7277 hybrid_clock.cc:648] HybridClock initialized: now 1786431794019849 us; error 48 us; skew 500 ppm
I20260811 07:03:14.020346 7277 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:14 dist-test-slave-69rg krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431794, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:14.024658 7277 init.cc:377] Logged in from keytab as oryx/127.30.73.65@KRBTEST.COM (short username oryx)
I20260811 07:03:14.027170 7277 webserver.cc:460] Webserver started at http://127.30.73.65:46365/ using document root <none> and password file <none>
I20260811 07:03:14.028367 7277 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:14.028666 7277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:14.029605 7277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:14.034400 7277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "9f4ee3e354e845b28732ab1e0006bcef"
format_stamp: "Formatted at 2026-08-11 07:03:14 on dist-test-slave-69rg"
server_key: "ee4169edadedda5dce6976b4b7bdc57a"
server_key_iv: "91eba605a66aa46f4958df868d99a094"
server_key_version: "encryptionkey@0"
I20260811 07:03:14.035405 7277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "9f4ee3e354e845b28732ab1e0006bcef"
format_stamp: "Formatted at 2026-08-11 07:03:14 on dist-test-slave-69rg"
server_key: "ee4169edadedda5dce6976b4b7bdc57a"
server_key_iv: "91eba605a66aa46f4958df868d99a094"
server_key_version: "encryptionkey@0"
I20260811 07:03:14.041738 7277 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:03:14.046433 7292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:14.048507 7277 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:03:14.048743 7277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "9f4ee3e354e845b28732ab1e0006bcef"
format_stamp: "Formatted at 2026-08-11 07:03:14 on dist-test-slave-69rg"
server_key: "ee4169edadedda5dce6976b4b7bdc57a"
server_key_iv: "91eba605a66aa46f4958df868d99a094"
server_key_version: "encryptionkey@0"
I20260811 07:03:14.049028 7277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:14.074186 7277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:14.081151 7277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:14.081764 7277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:14.085141 7277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:14.085274 7277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:14.085446 7277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:14.085561 7277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:03:14 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431794, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:14.121152 7301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:14.085842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:50317 (local address 127.30.73.126:35103)
0811 07:03:14.086572 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:14.086579 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:14.087731 (+ 1152us) server_negotiation.cc:407] Connection header received
0811 07:03:14.091117 (+ 3386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:14.091124 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:14.091276 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:14.093060 (+ 1784us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:14.095367 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.097174 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.100288 (+ 3114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.100948 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.101117 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:14.108929 (+ 7812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:14.108936 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:14.108940 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:14.108982 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:14.115999 (+ 7017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:14.117937 (+ 1938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:14.117941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:14.117944 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:14.118124 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:14.118873 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:14.118878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:14.118880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:14.119318 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:14.119505 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:14.120344 (+ 839us) server_negotiation.cc:299] Negotiation successful
0811 07:03:14.120617 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":427,"threads_started":1}
I20260811 07:03:14.123196 7302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:14.086530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35103 (local address 127.30.73.65:50317)
0811 07:03:14.087505 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:14.087573 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:14.090696 (+ 3123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:14.092232 (+ 1536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:14.092253 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:14.093882 (+ 1629us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:14.095019 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:14.095080 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.097428 (+ 2348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.097440 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:14.100090 (+ 2650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:14.100108 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.101517 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.101523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:14.101751 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:14.102748 (+ 997us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:14.102786 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:14.108225 (+ 5439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:14.116316 (+ 8091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:14.116327 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:14.116348 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:14.117693 (+ 1345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:14.118263 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:14.118270 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:14.118275 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:14.118687 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:14.119481 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:14.119490 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:14.119932 (+ 442us) client_negotiation.cc:769] Sending connection context
0811 07:03:14.120230 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 07:03:14.120958 (+ 728us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":393,"threads_started":1}
I20260811 07:03:14.163550 7376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:14.138541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35103 (local address 127.30.73.65:34751)
0811 07:03:14.139534 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:14.139568 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:14.139813 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:14.140608 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:14.140615 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:14.141912 (+ 1297us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:14.142664 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:14.142693 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.144542 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.144547 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:14.146522 (+ 1975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:14.146548 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.148748 (+ 2200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.148756 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:14.148900 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:14.150410 (+ 1510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:14.150428 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:14.151321 (+ 893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:14.158260 (+ 6939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:14.158265 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:14.158268 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:14.158883 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:14.159513 (+ 630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:14.159526 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:14.159532 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:14.159830 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:14.160641 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:14.160650 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:14.161049 (+ 399us) client_negotiation.cc:769] Sending connection context
0811 07:03:14.161338 (+ 289us) client_negotiation.cc:240] Negotiation successful
0811 07:03:14.162287 (+ 949us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"thread_start_us":553,"threads_started":1}
I20260811 07:03:14.164105 7301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:14.138492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:34751 (local address 127.30.73.126:35103)
0811 07:03:14.138811 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:14.138818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:14.139709 (+ 891us) server_negotiation.cc:407] Connection header received
0811 07:03:14.140057 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:14.140067 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:14.140182 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:14.140292 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:14.143097 (+ 2805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.144364 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.147259 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.148181 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.148360 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:14.151582 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:14.151593 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:14.151601 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:14.151661 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:14.158009 (+ 6348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:14.159113 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:14.159121 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:14.159126 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:14.159325 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:14.160009 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:14.160015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:14.160021 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:14.160441 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:14.160601 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:14.163068 (+ 2467us) server_negotiation.cc:299] Negotiation successful
0811 07:03:14.163589 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 07:03:14.188550 7427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:42763 every 8 connection(s)
I20260811 07:03:14.188664 7277 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:42763
I20260811 07:03:14.190915 7277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:03:14.193004 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 7277
I20260811 07:03:14.193266 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:03:14.194058 31013 external_mini_cluster.cc:1428] Setting key c46b43c787c7f077e4435c9e9d97ef50
I20260811 07:03:14.194319 7428 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35103
I20260811 07:03:14.194602 7428 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:14.195509 7428 heartbeater.cc:511] Master 127.30.73.126:35103 requested a full tablet report, sending...
I20260811 07:03:14.198271 7194 ts_manager.cc:194] Registered new tserver with Master: 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65:42763)
I20260811 07:03:14.202028 7194 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:50317
WARNING: no policy specified for oryx/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab.
Entry for principal oryx/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab.
I20260811 07:03:14.271627 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35103
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab
--principal=oryx/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:43505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:14.714457 7434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:14.714828 7434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:14.715014 7434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:14.722873 7434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:14.723064 7434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:14.723237 7434 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:03:14.723384 7434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:03:14.738349 7434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:43505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab
--principal=oryx/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.73.126:35103
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:14.739864 7434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:14.741358 7434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:14.758599 7439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:14.758890 7442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:14.758944 7440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:14.760295 7434 server_base.cc:1034] running on GCE node
I20260811 07:03:14.760985 7434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:14.762079 7434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:14.763437 7434 hybrid_clock.cc:648] HybridClock initialized: now 1786431794763318 us; error 90 us; skew 500 ppm
I20260811 07:03:14.763921 7434 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:14 dist-test-slave-69rg krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431794, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:14.767576 7434 init.cc:377] Logged in from keytab as oryx/127.30.73.66@KRBTEST.COM (short username oryx)
I20260811 07:03:14.769518 7434 webserver.cc:460] Webserver started at http://127.30.73.66:38815/ using document root <none> and password file <none>
I20260811 07:03:14.771085 7434 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:14.771210 7434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:14.771597 7434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:14.775144 7434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "d0a07002fe484f898f6feb7612ab6a6e"
format_stamp: "Formatted at 2026-08-11 07:03:14 on dist-test-slave-69rg"
server_key: "3e79c6d4956d994b9a7a47e9d2b4e943"
server_key_iv: "0cdebd6f6d3f7de72a0fd4dd38ccf4a6"
server_key_version: "encryptionkey@0"
I20260811 07:03:14.776021 7434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "d0a07002fe484f898f6feb7612ab6a6e"
format_stamp: "Formatted at 2026-08-11 07:03:14 on dist-test-slave-69rg"
server_key: "3e79c6d4956d994b9a7a47e9d2b4e943"
server_key_iv: "0cdebd6f6d3f7de72a0fd4dd38ccf4a6"
server_key_version: "encryptionkey@0"
I20260811 07:03:14.782445 7434 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:03:14.787716 7451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:14.789954 7434 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:03:14.790195 7434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "d0a07002fe484f898f6feb7612ab6a6e"
format_stamp: "Formatted at 2026-08-11 07:03:14 on dist-test-slave-69rg"
server_key: "3e79c6d4956d994b9a7a47e9d2b4e943"
server_key_iv: "0cdebd6f6d3f7de72a0fd4dd38ccf4a6"
server_key_version: "encryptionkey@0"
I20260811 07:03:14.790454 7434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:14.815267 7434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:14.820302 7434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:14.820783 7434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:14.824591 7434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:14.824918 7434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:14.825407 7434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:14.825511 7434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:03:14 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431794, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:14.857023 7463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:14.826833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:35959 (local address 127.30.73.126:35103)
0811 07:03:14.827439 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:14.827447 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:14.828837 (+ 1390us) server_negotiation.cc:407] Connection header received
0811 07:03:14.831342 (+ 2505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:14.831349 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:14.831451 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:14.831579 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:14.834798 (+ 3219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.835854 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.840529 (+ 4675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.841199 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.841416 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:14.847125 (+ 5709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:14.847131 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:14.847135 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:14.847174 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:14.852231 (+ 5057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:14.853529 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:14.853539 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:14.853551 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:14.853773 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:14.854744 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:14.854751 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:14.854757 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:14.855090 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:14.855233 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:14.856469 (+ 1236us) server_negotiation.cc:299] Negotiation successful
0811 07:03:14.856709 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":286,"threads_started":1}
I20260811 07:03:14.859508 7465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:14.827560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35103 (local address 127.30.73.66:35959)
0811 07:03:14.828626 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:14.828688 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:14.830922 (+ 2234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:14.832037 (+ 1115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:14.832052 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:14.833282 (+ 1230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:14.834444 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:14.834481 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.836098 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.836107 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:14.840249 (+ 4142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:14.840274 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.841564 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.841573 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:14.841998 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:14.842941 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:14.842993 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:14.846808 (+ 3815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:14.852557 (+ 5749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:14.852574 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:14.852602 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:14.853373 (+ 771us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:14.854012 (+ 639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:14.854017 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:14.854021 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:14.854522 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:14.855248 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:14.855261 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:14.855926 (+ 665us) client_negotiation.cc:769] Sending connection context
0811 07:03:14.856342 (+ 416us) client_negotiation.cc:240] Negotiation successful
0811 07:03:14.857119 (+ 777us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":478,"threads_started":1}
I20260811 07:03:14.894052 7540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:14.868515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35103 (local address 127.30.73.66:35023)
0811 07:03:14.870179 (+ 1664us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:14.870204 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:14.870484 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:14.870927 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:14.870932 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:14.871799 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:14.872193 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:14.872210 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.873403 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.873408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:14.874968 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:14.874990 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.876101 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.876119 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:14.876495 (+ 376us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:14.877953 (+ 1458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:14.878027 (+ 74us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:14.880119 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:14.885476 (+ 5357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:14.885576 (+ 100us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:14.885588 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:14.886604 (+ 1016us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:14.889124 (+ 2520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:14.889133 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:14.889137 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:14.889609 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:14.892039 (+ 2430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:14.892050 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:14.892521 (+ 471us) client_negotiation.cc:769] Sending connection context
0811 07:03:14.892797 (+ 276us) client_negotiation.cc:240] Negotiation successful
0811 07:03:14.893284 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1242,"thread_start_us":920,"threads_started":1}
I20260811 07:03:14.894801 7463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:14.868411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:35023 (local address 127.30.73.126:35103)
0811 07:03:14.868619 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:14.868625 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:14.870371 (+ 1746us) server_negotiation.cc:407] Connection header received
0811 07:03:14.870653 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:14.870659 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:14.870758 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:14.870882 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:14.872458 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.873225 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.875146 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:14.875715 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:14.875871 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:14.880538 (+ 4667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:14.880550 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:14.880559 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:14.880748 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:14.884936 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:14.886912 (+ 1976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:14.886920 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:14.886922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:14.887322 (+ 400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:14.889936 (+ 2614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:14.889946 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:14.889951 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:14.891261 (+ 1310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:14.891691 (+ 430us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:14.894102 (+ 2411us) server_negotiation.cc:299] Negotiation successful
0811 07:03:14.894483 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:03:14.901364 7434 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:32855
I20260811 07:03:14.901414 7590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:32855 every 8 connection(s)
I20260811 07:03:14.902936 7434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:03:14.906860 7591 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35103
I20260811 07:03:14.907531 7591 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:14.908614 7591 heartbeater.cc:511] Master 127.30.73.126:35103 requested a full tablet report, sending...
I20260811 07:03:14.910871 7194 ts_manager.cc:194] Registered new tserver with Master: d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855)
I20260811 07:03:14.911780 7194 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:35959
I20260811 07:03:14.912617 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 7434
I20260811 07:03:14.912814 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:03:14.913287 31013 external_mini_cluster.cc:1428] Setting key 1453ecfebf47b361b0506dc3f89ec369
WARNING: no policy specified for oryx/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab.
Entry for principal oryx/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab.
I20260811 07:03:14.997241 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35103
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab
--principal=oryx/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:43505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:03:15.206072 7428 heartbeater.cc:503] Master 127.30.73.126:35103 was elected leader, sending a full tablet report...
W20260811 07:03:15.514364 7597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:15.514882 7597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:15.515105 7597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:15.524204 7597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:15.524446 7597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:15.524642 7597 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:03:15.524819 7597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:03:15.537376 7597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:43505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab
--principal=oryx/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.73.126:35103
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:15.539413 7597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:15.541704 7597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:15.560948 7603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:15.560911 7605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:15.560930 7602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:15.561947 7597 server_base.cc:1034] running on GCE node
I20260811 07:03:15.562837 7597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:15.564141 7597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:15.565397 7597 hybrid_clock.cc:648] HybridClock initialized: now 1786431795565317 us; error 50 us; skew 500 ppm
I20260811 07:03:15.565857 7597 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:15 dist-test-slave-69rg krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431795, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:15.570509 7597 init.cc:377] Logged in from keytab as oryx/127.30.73.67@KRBTEST.COM (short username oryx)
I20260811 07:03:15.572960 7597 webserver.cc:460] Webserver started at http://127.30.73.67:36517/ using document root <none> and password file <none>
I20260811 07:03:15.574121 7597 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:15.574294 7597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:15.574735 7597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:15.579733 7597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8"
format_stamp: "Formatted at 2026-08-11 07:03:15 on dist-test-slave-69rg"
server_key: "0b915b492df70a4d10705f99a85938eb"
server_key_iv: "0b76da6592868733021f942e59605a77"
server_key_version: "encryptionkey@0"
I20260811 07:03:15.581135 7597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8"
format_stamp: "Formatted at 2026-08-11 07:03:15 on dist-test-slave-69rg"
server_key: "0b915b492df70a4d10705f99a85938eb"
server_key_iv: "0b76da6592868733021f942e59605a77"
server_key_version: "encryptionkey@0"
I20260811 07:03:15.590330 7597 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.010s sys 0.001s
I20260811 07:03:15.595840 7612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:15.598155 7597 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:03:15.598423 7597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8"
format_stamp: "Formatted at 2026-08-11 07:03:15 on dist-test-slave-69rg"
server_key: "0b915b492df70a4d10705f99a85938eb"
server_key_iv: "0b76da6592868733021f942e59605a77"
server_key_version: "encryptionkey@0"
I20260811 07:03:15.598750 7597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:15.620765 7597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:15.627749 7597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:15.628173 7597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:15.632084 7597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:15.632234 7597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:15.632441 7597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:15.632548 7597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:03:15 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431795, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:15.667560 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:15.634341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:50829 (local address 127.30.73.126:35103)
0811 07:03:15.635119 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:15.635127 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:15.636011 (+ 884us) server_negotiation.cc:407] Connection header received
0811 07:03:15.639401 (+ 3390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:15.639408 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:15.639506 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:15.639655 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:15.643827 (+ 4172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.645035 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.648078 (+ 3043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.648809 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.648996 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:15.656443 (+ 7447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:15.656454 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:15.656460 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:15.656533 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:15.661213 (+ 4680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:15.663333 (+ 2120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:15.663342 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:15.663346 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:15.663624 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:15.664556 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:15.664565 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:15.664571 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:15.665111 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:15.665338 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:15.666719 (+ 1381us) server_negotiation.cc:299] Negotiation successful
0811 07:03:15.667063 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":371,"threads_started":1}
I20260811 07:03:15.669067 7630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:15.634152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35103 (local address 127.30.73.67:50829)
0811 07:03:15.635726 (+ 1574us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:15.635791 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:15.638888 (+ 3097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:15.640419 (+ 1531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:15.640440 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:15.641634 (+ 1194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:15.643386 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:15.643431 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.645349 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.645357 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:15.647828 (+ 2471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:15.647864 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.649151 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.649162 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:15.649512 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:15.650692 (+ 1180us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:15.650726 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:15.655889 (+ 5163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:15.661619 (+ 5730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:15.661640 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:15.661697 (+ 57us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:15.663013 (+ 1316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:15.663830 (+ 817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:15.663840 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:15.663846 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:15.664317 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:15.665318 (+ 1001us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:15.665335 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:15.666140 (+ 805us) client_negotiation.cc:769] Sending connection context
0811 07:03:15.666603 (+ 463us) client_negotiation.cc:240] Negotiation successful
0811 07:03:15.667385 (+ 782us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1175,"thread_start_us":711,"threads_started":1}
I20260811 07:03:15.704747 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:15.682885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:58261 (local address 127.30.73.126:35103)
0811 07:03:15.683290 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:15.683300 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:15.684825 (+ 1525us) server_negotiation.cc:407] Connection header received
0811 07:03:15.685188 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:15.685201 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:15.685352 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:15.685702 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:15.688082 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.688948 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.690548 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.691030 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.691185 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:15.696376 (+ 5191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:15.696390 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:15.696394 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:15.696444 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:15.700752 (+ 4308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:15.701760 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:15.701771 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:15.701773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:15.702019 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:15.702741 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:15.702746 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:15.702749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:15.703146 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:15.703312 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:15.704151 (+ 839us) server_negotiation.cc:299] Negotiation successful
0811 07:03:15.704393 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260811 07:03:15.705691 7725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:15.682697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35103 (local address 127.30.73.67:58261)
0811 07:03:15.684619 (+ 1922us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:15.684654 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:15.684845 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:15.685763 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:15.685767 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:15.686989 (+ 1222us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:15.687842 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:15.687867 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.689146 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.689152 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:15.690354 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:15.690377 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.691285 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.691294 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:15.691609 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:15.692943 (+ 1334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:15.692966 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:15.695723 (+ 2757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:15.701016 (+ 5293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:15.701022 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:15.701027 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:15.701595 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:15.702226 (+ 631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:15.702236 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:15.702244 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:15.702536 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:15.703305 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:15.703315 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:15.703676 (+ 361us) client_negotiation.cc:769] Sending connection context
0811 07:03:15.703949 (+ 273us) client_negotiation.cc:240] Negotiation successful
0811 07:03:15.704608 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1664,"thread_start_us":767,"threads_started":1}
I20260811 07:03:15.717042 7597 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:35061
I20260811 07:03:15.717088 7759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:35061 every 8 connection(s)
I20260811 07:03:15.718935 7597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:03:15.721978 7760 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35103
I20260811 07:03:15.722290 7760 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:15.723220 7760 heartbeater.cc:511] Master 127.30.73.126:35103 requested a full tablet report, sending...
I20260811 07:03:15.725203 7194 ts_manager.cc:194] Registered new tserver with Master: f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061)
I20260811 07:03:15.726016 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 7597
I20260811 07:03:15.726234 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:03:15.726590 7194 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:50829
I20260811 07:03:15.726830 31013 external_mini_cluster.cc:1428] Setting key 21bb716307dd20673a5a75b3827312c1
I20260811 07:03:15.731396 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:03:15 dist-test-slave-69rg krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431795, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:03:15 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:15 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:15.915060 7591 heartbeater.cc:503] Master 127.30.73.126:35103 was elected leader, sending a full tablet report...
I20260811 07:03:16.730998 7760 heartbeater.cc:503] Master 127.30.73.126:35103 was elected leader, sending a full tablet report...
W20260811 07:03:17.080472 7770 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.271s user 0.004s sys 0.022s
W20260811 07:03:17.082207 7629 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:15.801996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42514 (local address 127.30.73.126:35103)
0811 07:03:15.802288 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:15.802296 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:15.802477 (+ 181us) server_negotiation.cc:407] Connection header received
0811 07:03:15.802809 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:15.802814 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:15.802925 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:15.803075 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:15.804988 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.805983 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.807474 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:15.808210 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:15.808393 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.081806 (+1273413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42514: BlockingRecv error: recv got EOF from 127.0.0.1:42514 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 07:03:17 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431795, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:17.108011 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.088065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42516 (local address 127.30.73.126:35103)
0811 07:03:17.088265 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.088270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.088408 (+ 138us) server_negotiation.cc:407] Connection header received
0811 07:03:17.088600 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.088605 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.089030 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.089170 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:17.091031 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.091883 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.093285 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.094445 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.094864 (+ 419us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.100291 (+ 5427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:17.100299 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:17.100302 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:17.100353 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:17.104112 (+ 3759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:17.105601 (+ 1489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:17.105607 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:17.105610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:17.106032 (+ 422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:17.106520 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:17.106524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:17.106527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:17.106883 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:17.107150 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.107480 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.107715 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:03:17.114288 7194 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42516:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:03:17.122689 7194 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:03:17.151947 7788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.139175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:32855 (local address 127.0.0.1:59276)
0811 07:03:17.140148 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.140221 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.140616 (+ 395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.142308 (+ 1692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.142318 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.142358 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:17.142974 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.142994 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.145813 (+ 2819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.145843 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.148615 (+ 2772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.148635 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.150711 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.150719 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.150934 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.151001 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.151126 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.151339 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"mutex_wait_us":34,"thread_start_us":404,"threads_started":1}
I20260811 07:03:17.152252 7790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.139506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59276 (local address 127.30.73.66:32855)
0811 07:03:17.141450 (+ 1944us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.141461 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.141497 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:03:17.141611 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.141620 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.141974 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.143272 (+ 1298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:17.143506 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.145565 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.148823 (+ 3258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.150436 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.151294 (+ 858us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.151609 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.151744 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.151943 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1710,"thread_start_us":2863,"threads_started":1}
I20260811 07:03:17.154068 7794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.140657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48804 (local address 127.30.73.67:35061)
0811 07:03:17.144774 (+ 4117us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.144800 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.144839 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:03:17.145074 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.145083 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.145351 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.146606 (+ 1255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:17.146845 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.148413 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.151293 (+ 2880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.152856 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.153012 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.153205 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.153542 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.153730 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3848,"thread_start_us":3695,"threads_started":1}
I20260811 07:03:17.154184 7791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.140034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:35061 (local address 127.0.0.1:48804)
0811 07:03:17.143291 (+ 3257us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.143314 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.143437 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.145609 (+ 2172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.145618 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.145651 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:17.146380 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.146393 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.148606 (+ 2213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.148614 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.151091 (+ 2477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.151106 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.153089 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.153100 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.153311 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.153348 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.153453 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.153736 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3086,"mutex_wait_us":4,"thread_start_us":2907,"threads_started":1}
I20260811 07:03:17.156939 7513 tablet_service.cc:1467] Processing CreateTablet for tablet e32b8b5fefa14a59ad3522d5299ef039 (DEFAULT_TABLE table=test-table [id=c2c7229e874d4727be97d064f5a8b745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:17.157737 7792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.140547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:42763 (local address 127.0.0.1:46336)
0811 07:03:17.149165 (+ 8618us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.149187 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.149319 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.150276 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.150281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.150309 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:17.150818 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.150831 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.152701 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.152707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.155207 (+ 2500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.155226 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.156924 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.156930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.157109 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.157146 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.157253 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.157391 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8477,"thread_start_us":8271,"threads_started":1}
I20260811 07:03:17.157784 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.141181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46336 (local address 127.30.73.65:42763)
0811 07:03:17.144197 (+ 3016us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.144206 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.149323 (+ 5117us) server_negotiation.cc:407] Connection header received
0811 07:03:17.149469 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.149479 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.149745 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.149988 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:17.151035 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.152549 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.155420 (+ 2871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.156696 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.156863 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.157065 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.157320 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.157479 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2842,"thread_start_us":2647,"threads_started":1}
I20260811 07:03:17.160912 7677 tablet_service.cc:1467] Processing CreateTablet for tablet e32b8b5fefa14a59ad3522d5299ef039 (DEFAULT_TABLE table=test-table [id=c2c7229e874d4727be97d064f5a8b745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:17.161213 7349 tablet_service.cc:1467] Processing CreateTablet for tablet e32b8b5fefa14a59ad3522d5299ef039 (DEFAULT_TABLE table=test-table [id=c2c7229e874d4727be97d064f5a8b745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:17.162353 7513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32b8b5fefa14a59ad3522d5299ef039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:17.162853 7677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32b8b5fefa14a59ad3522d5299ef039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:17.163216 7349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32b8b5fefa14a59ad3522d5299ef039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:17.186767 7797 tablet_bootstrap.cc:492] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: Bootstrap starting.
I20260811 07:03:17.188335 7796 tablet_bootstrap.cc:492] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: Bootstrap starting.
I20260811 07:03:17.195505 7798 tablet_bootstrap.cc:492] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: Bootstrap starting.
I20260811 07:03:17.197578 7797 tablet_bootstrap.cc:654] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:17.197587 7796 tablet_bootstrap.cc:654] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:17.199239 7796 log.cc:824] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:17.199232 7797 log.cc:824] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:17.199569 7798 tablet_bootstrap.cc:654] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:17.201116 7798 log.cc:824] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:17.207412 7797 tablet_bootstrap.cc:492] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: No bootstrap required, opened a new log
I20260811 07:03:17.207988 7797 ts_tablet_manager.cc:1397] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.006s
I20260811 07:03:17.210351 7798 tablet_bootstrap.cc:492] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: No bootstrap required, opened a new log
I20260811 07:03:17.210352 7796 tablet_bootstrap.cc:492] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: No bootstrap required, opened a new log
I20260811 07:03:17.210659 7798 ts_tablet_manager.cc:1397] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260811 07:03:17.210661 7796 ts_tablet_manager.cc:1397] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.006s
I20260811 07:03:17.217291 7797 raft_consensus.cc:348] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.218202 7797 raft_consensus.cc:374] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:17.218380 7797 raft_consensus.cc:729] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67d6a8edd3446fda7ebf18ef0a4ebb8, State: Initialized, Role: FOLLOWER
I20260811 07:03:17.219170 7797 consensus_queue.cc:260] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.222653 7797 ts_tablet_manager.cc:1428] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260811 07:03:17.222527 7798 raft_consensus.cc:348] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.222523 7796 raft_consensus.cc:348] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.223109 7796 raft_consensus.cc:374] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:17.223140 7798 raft_consensus.cc:374] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:17.223256 7798 raft_consensus.cc:729] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a07002fe484f898f6feb7612ab6a6e, State: Initialized, Role: FOLLOWER
I20260811 07:03:17.223276 7796 raft_consensus.cc:729] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4ee3e354e845b28732ab1e0006bcef, State: Initialized, Role: FOLLOWER
W20260811 07:03:17.223302 7761 tablet.cc:2369] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:03:17.224059 7796 consensus_queue.cc:260] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.224069 7798 consensus_queue.cc:260] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.226647 7796 ts_tablet_manager.cc:1428] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: Time spent starting tablet: real 0.016s user 0.015s sys 0.001s
I20260811 07:03:17.226979 7798 ts_tablet_manager.cc:1428] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260811 07:03:17.248405 7806 raft_consensus.cc:482] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:03:17.248888 7806 raft_consensus.cc:504] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.250896 7806 leader_election.cc:288] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855), f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061)
I20260811 07:03:17.258756 7794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.251483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:55605 (local address 127.30.73.67:35061)
0811 07:03:17.251736 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.251745 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.252906 (+ 1161us) server_negotiation.cc:407] Connection header received
0811 07:03:17.253213 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.253219 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.253311 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.253421 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:17.254206 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.254984 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.256867 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.257721 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.257951 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.258033 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.258350 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.258487 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 07:03:17.258937 7808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.251594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:35061 (local address 127.30.73.65:55605)
0811 07:03:17.252764 (+ 1170us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.252780 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.252996 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.253449 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.253454 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.253496 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:17.254028 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.254040 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.255130 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.255135 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.256690 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.256706 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.257978 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.257984 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.258168 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.258193 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.258319 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.258474 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"mutex_wait_us":5,"thread_start_us":843,"threads_started":1}
I20260811 07:03:17.259475 7790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.251744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:59163 (local address 127.30.73.66:32855)
0811 07:03:17.252045 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.252054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.253133 (+ 1079us) server_negotiation.cc:407] Connection header received
0811 07:03:17.253513 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.253519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.253668 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.253791 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:17.254618 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.255398 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.257210 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.258131 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.258332 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.258610 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.259084 (+ 474us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.259232 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260811 07:03:17.260105 7807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.251540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:32855 (local address 127.30.73.65:59163)
0811 07:03:17.252623 (+ 1083us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.252773 (+ 150us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.253234 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.253860 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.253865 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.254020 (+ 155us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:17.254429 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.254442 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.255569 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.255574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.257019 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.257032 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.258369 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.258375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.258806 (+ 431us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.258836 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.259558 (+ 722us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.259721 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":922,"mutex_wait_us":29,"thread_start_us":562,"threads_started":1}
I20260811 07:03:17.260097 7700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e32b8b5fefa14a59ad3522d5299ef039" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" is_pre_election: true
I20260811 07:03:17.260763 7700 raft_consensus.cc:2454] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 0.
I20260811 07:03:17.261346 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e32b8b5fefa14a59ad3522d5299ef039" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e" is_pre_election: true
I20260811 07:03:17.261590 7294 leader_election.cc:302] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4ee3e354e845b28732ab1e0006bcef, f67d6a8edd3446fda7ebf18ef0a4ebb8; no voters:
I20260811 07:03:17.261929 7541 raft_consensus.cc:2454] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 0.
I20260811 07:03:17.262130 7806 raft_consensus.cc:2781] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:03:17.262293 7806 raft_consensus.cc:482] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:03:17.262458 7806 raft_consensus.cc:3037] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:17.264998 7806 raft_consensus.cc:504] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.265874 7806 leader_election.cc:288] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 election: Requested vote from peers d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855), f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061)
I20260811 07:03:17.266448 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e32b8b5fefa14a59ad3522d5299ef039" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e"
I20260811 07:03:17.266615 7700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e32b8b5fefa14a59ad3522d5299ef039" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8"
I20260811 07:03:17.266721 7541 raft_consensus.cc:3037] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:17.266872 7700 raft_consensus.cc:3037] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:17.270316 7700 raft_consensus.cc:2454] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 1.
I20260811 07:03:17.270316 7541 raft_consensus.cc:2454] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 1.
I20260811 07:03:17.270937 7293 leader_election.cc:302] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9f4ee3e354e845b28732ab1e0006bcef, d0a07002fe484f898f6feb7612ab6a6e, f67d6a8edd3446fda7ebf18ef0a4ebb8; no voters:
I20260811 07:03:17.271359 7806 raft_consensus.cc:2781] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:17.271941 7806 raft_consensus.cc:686] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 1 LEADER]: Becoming Leader. State: Replica: 9f4ee3e354e845b28732ab1e0006bcef, State: Running, Role: LEADER
I20260811 07:03:17.272553 7806 consensus_queue.cc:237] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.277751 7192 catalog_manager.cc:5495] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65). New cstate: current_term: 1 leader_uuid: "9f4ee3e354e845b28732ab1e0006bcef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } health_report { overall_health: UNKNOWN } } }
I20260811 07:03:17.312456 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.306154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46340 (local address 127.30.73.65:42763)
0811 07:03:17.306374 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.306378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.306644 (+ 266us) server_negotiation.cc:407] Connection header received
0811 07:03:17.306891 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.306896 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.306982 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.307132 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:17.307564 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.308291 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.309687 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.310221 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.310338 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.310863 (+ 525us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:17.311508 (+ 645us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:17.311637 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.312076 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.312208 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:03:17.323235 7700 raft_consensus.cc:1261] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Refusing update from remote peer 9f4ee3e354e845b28732ab1e0006bcef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:17.323237 7541 raft_consensus.cc:1261] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Refusing update from remote peer 9f4ee3e354e845b28732ab1e0006bcef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:17.325307 7809 consensus_queue.cc:1035] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:17.325786 7806 consensus_queue.cc:1035] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:17.365473 7192 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:17.365828 7192 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:17.370059 7192 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922: Sending DeleteTablet for 3 replicas of tablet e32b8b5fefa14a59ad3522d5299ef039
I20260811 07:03:17.371515 7677 tablet_service.cc:1514] Processing DeleteTablet for tablet e32b8b5fefa14a59ad3522d5299ef039 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:17 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:48804
I20260811 07:03:17.371683 7349 tablet_service.cc:1514] Processing DeleteTablet for tablet e32b8b5fefa14a59ad3522d5299ef039 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:17 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:46336
I20260811 07:03:17.372555 7513 tablet_service.cc:1514] Processing DeleteTablet for tablet e32b8b5fefa14a59ad3522d5299ef039 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:17 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:59276
I20260811 07:03:17.373725 7192 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42516:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:03:17.375264 7192 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:03:17.379714 7824 tablet_replica.cc:330] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: stopping tablet replica
I20260811 07:03:17.380584 7824 raft_consensus.cc:2229] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:17.381335 7824 raft_consensus.cc:2258] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:17.384562 7824 ts_tablet_manager.cc:1905] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:17.392699 7824 ts_tablet_manager.cc:1918] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:17.392870 7512 tablet_service.cc:1467] Processing CreateTablet for tablet 4b3cad7864ad456287b8aaa2febb865b (DEFAULT_TABLE table=test-table [id=188ca36f7f504f5a9a52b09a5fdcae1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:17.393450 7826 tablet_replica.cc:330] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: stopping tablet replica
I20260811 07:03:17.393603 7512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b3cad7864ad456287b8aaa2febb865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:17.394030 7826 raft_consensus.cc:2229] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:17.394482 7677 tablet_service.cc:1467] Processing CreateTablet for tablet 4b3cad7864ad456287b8aaa2febb865b (DEFAULT_TABLE table=test-table [id=188ca36f7f504f5a9a52b09a5fdcae1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:17.394958 7826 raft_consensus.cc:2258] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:17.395010 7677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b3cad7864ad456287b8aaa2febb865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:17.395417 7824 log.cc:1196] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/e32b8b5fefa14a59ad3522d5299ef039
I20260811 07:03:17.395982 7348 tablet_service.cc:1467] Processing CreateTablet for tablet 4b3cad7864ad456287b8aaa2febb865b (DEFAULT_TABLE table=test-table [id=188ca36f7f504f5a9a52b09a5fdcae1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:17.396729 7348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b3cad7864ad456287b8aaa2febb865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:17.398629 7826 ts_tablet_manager.cc:1905] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:17.399142 7824 ts_tablet_manager.cc:1939] T e32b8b5fefa14a59ad3522d5299ef039 P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting consensus metadata
I20260811 07:03:17.401484 7178 catalog_manager.cc:4841] TS f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061): tablet e32b8b5fefa14a59ad3522d5299ef039 (table test-table [id=c2c7229e874d4727be97d064f5a8b745]) successfully deleted
I20260811 07:03:17.402908 7798 tablet_bootstrap.cc:492] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: Bootstrap starting.
I20260811 07:03:17.403712 7825 tablet_replica.cc:330] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: stopping tablet replica
I20260811 07:03:17.403858 7797 tablet_bootstrap.cc:492] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: Bootstrap starting.
I20260811 07:03:17.404847 7798 tablet_bootstrap.cc:654] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:17.404232 7825 raft_consensus.cc:2229] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:03:17.405740 7797 tablet_bootstrap.cc:654] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:17.406064 7825 raft_consensus.cc:2258] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:17.406142 7796 tablet_bootstrap.cc:492] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: Bootstrap starting.
I20260811 07:03:17.408181 7796 tablet_bootstrap.cc:654] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:17.416224 7825 ts_tablet_manager.cc:1905] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:17.417570 7798 tablet_bootstrap.cc:492] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: No bootstrap required, opened a new log
I20260811 07:03:17.417843 7798 ts_tablet_manager.cc:1397] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.001s
I20260811 07:03:17.419095 7798 raft_consensus.cc:348] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.419561 7798 raft_consensus.cc:374] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:17.419757 7798 raft_consensus.cc:729] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a07002fe484f898f6feb7612ab6a6e, State: Initialized, Role: FOLLOWER
I20260811 07:03:17.420209 7798 consensus_queue.cc:260] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.424372 7798 ts_tablet_manager.cc:1428] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 07:03:17.428854 7825 ts_tablet_manager.cc:1918] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:17.429216 7825 log.cc:1196] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/e32b8b5fefa14a59ad3522d5299ef039
I20260811 07:03:17.431476 7796 tablet_bootstrap.cc:492] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: No bootstrap required, opened a new log
I20260811 07:03:17.431476 7797 tablet_bootstrap.cc:492] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: No bootstrap required, opened a new log
I20260811 07:03:17.431680 7797 ts_tablet_manager.cc:1397] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.010s
I20260811 07:03:17.431694 7796 ts_tablet_manager.cc:1397] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.004s
I20260811 07:03:17.432591 7797 raft_consensus.cc:348] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.432838 7797 raft_consensus.cc:374] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:17.432701 7796 raft_consensus.cc:348] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.432960 7796 raft_consensus.cc:374] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:17.432956 7797 raft_consensus.cc:729] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67d6a8edd3446fda7ebf18ef0a4ebb8, State: Initialized, Role: FOLLOWER
I20260811 07:03:17.433069 7796 raft_consensus.cc:729] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4ee3e354e845b28732ab1e0006bcef, State: Initialized, Role: FOLLOWER
I20260811 07:03:17.433288 7797 consensus_queue.cc:260] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.433388 7796 consensus_queue.cc:260] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.433969 7797 ts_tablet_manager.cc:1428] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 07:03:17.434726 7796 ts_tablet_manager.cc:1428] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 07:03:17.435503 7825 ts_tablet_manager.cc:1939] T e32b8b5fefa14a59ad3522d5299ef039 P 9f4ee3e354e845b28732ab1e0006bcef: Deleting consensus metadata
I20260811 07:03:17.436975 7826 ts_tablet_manager.cc:1918] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:17.437263 7826 log.cc:1196] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/e32b8b5fefa14a59ad3522d5299ef039
I20260811 07:03:17.437774 7176 catalog_manager.cc:4841] TS 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65:42763): tablet e32b8b5fefa14a59ad3522d5299ef039 (table test-table [id=c2c7229e874d4727be97d064f5a8b745]) successfully deleted
I20260811 07:03:17.438133 7826 ts_tablet_manager.cc:1939] T e32b8b5fefa14a59ad3522d5299ef039 P d0a07002fe484f898f6feb7612ab6a6e: Deleting consensus metadata
I20260811 07:03:17.441066 7176 catalog_manager.cc:4841] TS d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855): tablet e32b8b5fefa14a59ad3522d5299ef039 (table test-table [id=c2c7229e874d4727be97d064f5a8b745]) successfully deleted
W20260811 07:03:17.446542 7429 tablet.cc:2369] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:03:17.515733 7818 raft_consensus.cc:482] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:03:17.516034 7818 raft_consensus.cc:504] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.517261 7818 leader_election.cc:288] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855), f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061)
I20260811 07:03:17.518014 7700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b3cad7864ad456287b8aaa2febb865b" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" is_pre_election: true
I20260811 07:03:17.518028 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b3cad7864ad456287b8aaa2febb865b" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e" is_pre_election: true
I20260811 07:03:17.518337 7700 raft_consensus.cc:2454] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 0.
I20260811 07:03:17.518327 7541 raft_consensus.cc:2454] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 0.
I20260811 07:03:17.518873 7294 leader_election.cc:302] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4ee3e354e845b28732ab1e0006bcef, f67d6a8edd3446fda7ebf18ef0a4ebb8; no voters:
I20260811 07:03:17.519234 7818 raft_consensus.cc:2781] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:03:17.519366 7818 raft_consensus.cc:482] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:03:17.519470 7818 raft_consensus.cc:3037] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:17.523479 7818 raft_consensus.cc:504] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.524322 7818 leader_election.cc:288] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 election: Requested vote from peers d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855), f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061)
I20260811 07:03:17.525027 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b3cad7864ad456287b8aaa2febb865b" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e"
I20260811 07:03:17.525038 7700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b3cad7864ad456287b8aaa2febb865b" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8"
I20260811 07:03:17.525274 7541 raft_consensus.cc:3037] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:17.525274 7700 raft_consensus.cc:3037] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:17.528359 7700 raft_consensus.cc:2454] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 1.
I20260811 07:03:17.528538 7541 raft_consensus.cc:2454] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 1.
I20260811 07:03:17.529088 7294 leader_election.cc:302] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4ee3e354e845b28732ab1e0006bcef, f67d6a8edd3446fda7ebf18ef0a4ebb8; no voters:
I20260811 07:03:17.529484 7818 raft_consensus.cc:2781] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:17.529698 7818 raft_consensus.cc:686] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 1 LEADER]: Becoming Leader. State: Replica: 9f4ee3e354e845b28732ab1e0006bcef, State: Running, Role: LEADER
I20260811 07:03:17.530048 7818 consensus_queue.cc:237] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.533135 7193 catalog_manager.cc:5495] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65). New cstate: current_term: 1 leader_uuid: "9f4ee3e354e845b28732ab1e0006bcef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } health_report { overall_health: UNKNOWN } } }
Aug 11 07:03:17 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431793, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.126@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:17.604022 7838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.588861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35103 (local address 127.0.0.1:42530)
0811 07:03:17.589500 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.589516 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.589694 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.590075 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.590079 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.590839 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:17.591163 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.591179 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.592217 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.592225 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.593204 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.593217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.594031 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.594037 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.594208 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.594993 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:17.595011 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:17.597664 (+ 2653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:17.600830 (+ 3166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:17.600843 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:17.600851 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:17.601384 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:17.601843 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:17.601851 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:17.601855 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:17.602056 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:17.602693 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:17.602702 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:17.602916 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.603116 (+ 200us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.603432 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":366,"threads_started":1}
I20260811 07:03:17.604018 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.588769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42530 (local address 127.30.73.126:35103)
0811 07:03:17.588997 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.589002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.589619 (+ 617us) server_negotiation.cc:407] Connection header received
0811 07:03:17.589865 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.589870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.589936 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.590040 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:17.591341 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.592084 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.593362 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.593765 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.593983 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.597909 (+ 3926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:17.597915 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:17.597926 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:17.597956 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:17.600687 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:17.601506 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:17.601514 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:17.601517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:17.601648 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:17.602225 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:17.602229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:17.602231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:17.602536 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:17.602645 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.603212 (+ 567us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.603575 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":159,"server-negotiator.queue_time_us":101}
I20260811 07:03:17.610371 7193 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:42530:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:03:17.611749 7193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:03:17.620496 7349 tablet_service.cc:1467] Processing CreateTablet for tablet a9b4baf4a0ed4c0e884c37b42384c10c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e4767579e8784a35887b90013b6b082a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:03:17.620838 7512 tablet_service.cc:1467] Processing CreateTablet for tablet a9b4baf4a0ed4c0e884c37b42384c10c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e4767579e8784a35887b90013b6b082a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:03:17.621166 7349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9b4baf4a0ed4c0e884c37b42384c10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:17.621389 7512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9b4baf4a0ed4c0e884c37b42384c10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:17.621217 7677 tablet_service.cc:1467] Processing CreateTablet for tablet a9b4baf4a0ed4c0e884c37b42384c10c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e4767579e8784a35887b90013b6b082a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:03:17.621763 7677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9b4baf4a0ed4c0e884c37b42384c10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:17.629215 7796 tablet_bootstrap.cc:492] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: Bootstrap starting.
I20260811 07:03:17.630352 7798 tablet_bootstrap.cc:492] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: Bootstrap starting.
I20260811 07:03:17.631261 7796 tablet_bootstrap.cc:654] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:17.631778 7797 tablet_bootstrap.cc:492] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: Bootstrap starting.
I20260811 07:03:17.632164 7798 tablet_bootstrap.cc:654] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:17.633594 7797 tablet_bootstrap.cc:654] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:17.642192 7798 tablet_bootstrap.cc:492] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: No bootstrap required, opened a new log
I20260811 07:03:17.642417 7798 ts_tablet_manager.cc:1397] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.006s
I20260811 07:03:17.643293 7798 raft_consensus.cc:348] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.643534 7798 raft_consensus.cc:374] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:17.643590 7798 raft_consensus.cc:729] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a07002fe484f898f6feb7612ab6a6e, State: Initialized, Role: FOLLOWER
I20260811 07:03:17.644006 7797 tablet_bootstrap.cc:492] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: No bootstrap required, opened a new log
I20260811 07:03:17.644209 7797 ts_tablet_manager.cc:1397] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260811 07:03:17.644117 7798 consensus_queue.cc:260] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.644809 7798 ts_tablet_manager.cc:1428] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:03:17.644704 7805 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.645128 7805 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:03:17.644984 7797 raft_consensus.cc:348] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.645248 7797 raft_consensus.cc:374] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:17.645325 7797 raft_consensus.cc:729] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67d6a8edd3446fda7ebf18ef0a4ebb8, State: Initialized, Role: FOLLOWER
I20260811 07:03:17.645632 7797 consensus_queue.cc:260] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.646123 7803 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.646461 7803 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:03:17.647145 7796 tablet_bootstrap.cc:492] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: No bootstrap required, opened a new log
I20260811 07:03:17.647423 7796 ts_tablet_manager.cc:1397] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.007s
I20260811 07:03:17.648286 7796 raft_consensus.cc:348] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.648649 7796 raft_consensus.cc:374] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:17.648782 7796 raft_consensus.cc:729] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4ee3e354e845b28732ab1e0006bcef, State: Initialized, Role: FOLLOWER
I20260811 07:03:17.649135 7796 consensus_queue.cc:260] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.649672 7818 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.649910 7796 ts_tablet_manager.cc:1428] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 07:03:17.650040 7818 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:03:17.650437 7797 ts_tablet_manager.cc:1428] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
W20260811 07:03:17.659675 7592 tablet.cc:2369] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:03:17.732321 7803 raft_consensus.cc:482] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:03:17.732585 7803 raft_consensus.cc:504] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.734539 7803 leader_election.cc:288] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65:42763), d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855)
I20260811 07:03:17.743628 7790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.736350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:35423 (local address 127.30.73.66:32855)
0811 07:03:17.736552 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.736559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.736815 (+ 256us) server_negotiation.cc:407] Connection header received
0811 07:03:17.737035 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.737041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.737148 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.737251 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:17.738035 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.739169 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.741605 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.742475 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.742675 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.742761 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.743203 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.743332 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:03:17.743696 7843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.735891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:32855 (local address 127.30.73.67:35423)
0811 07:03:17.736693 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.736717 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.736885 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.737416 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.737422 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.737451 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:17.737802 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.737859 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.739330 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.739335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.741412 (+ 2077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.741445 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.742712 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.742718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.742915 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.742944 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.743131 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.743275 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":1,"spinlock_wait_cycles":1408,"thread_start_us":661,"threads_started":1}
I20260811 07:03:17.743889 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.734991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:51695 (local address 127.30.73.65:42763)
0811 07:03:17.735177 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.735184 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.735800 (+ 616us) server_negotiation.cc:407] Connection header received
0811 07:03:17.736103 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.736109 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.736229 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.736333 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:17.737296 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.738448 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.741074 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.742493 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.742675 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.742765 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.743391 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.743533 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:03:17.744694 7842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.734954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:42763 (local address 127.30.73.67:51695)
0811 07:03:17.735685 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.735705 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.735927 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.736616 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.736621 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.736649 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:17.737114 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.737124 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.738650 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.738655 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.740859 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.740876 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.742953 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.742961 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.743177 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.743212 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.744107 (+ 895us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.744260 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"mutex_wait_us":29,"spinlock_wait_cycles":51456,"thread_start_us":418,"threads_started":1}
I20260811 07:03:17.744932 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9b4baf4a0ed4c0e884c37b42384c10c" candidate_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e" is_pre_election: true
I20260811 07:03:17.745281 7541 raft_consensus.cc:2454] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f67d6a8edd3446fda7ebf18ef0a4ebb8 in term 0.
I20260811 07:03:17.745788 7615 leader_election.cc:302] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0a07002fe484f898f6feb7612ab6a6e, f67d6a8edd3446fda7ebf18ef0a4ebb8; no voters:
I20260811 07:03:17.745942 7375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9b4baf4a0ed4c0e884c37b42384c10c" candidate_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4ee3e354e845b28732ab1e0006bcef" is_pre_election: true
I20260811 07:03:17.746307 7803 raft_consensus.cc:2781] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:03:17.746445 7803 raft_consensus.cc:482] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:03:17.746570 7803 raft_consensus.cc:3037] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:17.746503 7375 raft_consensus.cc:2454] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f67d6a8edd3446fda7ebf18ef0a4ebb8 in term 0.
I20260811 07:03:17.748984 7803 raft_consensus.cc:504] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.749778 7803 leader_election.cc:288] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [CANDIDATE]: Term 1 election: Requested vote from peers 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65:42763), d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855)
I20260811 07:03:17.750696 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9b4baf4a0ed4c0e884c37b42384c10c" candidate_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e"
I20260811 07:03:17.750597 7375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9b4baf4a0ed4c0e884c37b42384c10c" candidate_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4ee3e354e845b28732ab1e0006bcef"
I20260811 07:03:17.750969 7541 raft_consensus.cc:3037] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:17.751124 7375 raft_consensus.cc:3037] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:17.753376 7541 raft_consensus.cc:2454] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f67d6a8edd3446fda7ebf18ef0a4ebb8 in term 1.
I20260811 07:03:17.753948 7615 leader_election.cc:302] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0a07002fe484f898f6feb7612ab6a6e, f67d6a8edd3446fda7ebf18ef0a4ebb8; no voters:
I20260811 07:03:17.754383 7803 raft_consensus.cc:2781] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:17.755175 7803 raft_consensus.cc:686] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 LEADER]: Becoming Leader. State: Replica: f67d6a8edd3446fda7ebf18ef0a4ebb8, State: Running, Role: LEADER
I20260811 07:03:17.755201 7375 raft_consensus.cc:2454] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f67d6a8edd3446fda7ebf18ef0a4ebb8 in term 1.
I20260811 07:03:17.755940 7803 consensus_queue.cc:237] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:17.758710 7844 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: TxnStatusTablet state changed. Reason: New leader f67d6a8edd3446fda7ebf18ef0a4ebb8. Latest consensus state: current_term: 1 leader_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.759172 7844 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:03:17.760665 7193 catalog_manager.cc:5495] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } health_report { overall_health: HEALTHY } } }
I20260811 07:03:17.761121 7846 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:03:17.761381 7846 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:03:17.814723 7838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.805863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:35061 (local address 127.0.0.1:48806)
0811 07:03:17.806903 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.806930 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.807102 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.807717 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.807722 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.807739 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:03:17.807972 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.807986 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.809602 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.809607 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.811312 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.811332 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.812396 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.812402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.812634 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.812728 (+ 94us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:03:17.814022 (+ 1294us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:03:17.814051 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.814156 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.814397 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811}
I20260811 07:03:17.814767 7849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.806355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48806 (local address 127.30.73.67:35061)
0811 07:03:17.807100 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.807107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.807140 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:03:17.807351 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.807356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.807479 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.807655 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:17.808159 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.809433 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.811483 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.812198 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.812334 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.813001 (+ 667us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:17.813890 (+ 889us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:17.814041 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.814247 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.814343 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":926,"threads_started":1}
I20260811 07:03:17.819952 7541 raft_consensus.cc:1261] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Refusing update from remote peer f67d6a8edd3446fda7ebf18ef0a4ebb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:17.820325 7375 raft_consensus.cc:1261] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Refusing update from remote peer f67d6a8edd3446fda7ebf18ef0a4ebb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:17.820840 7803 consensus_queue.cc:1035] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:17.821183 7844 consensus_queue.cc:1035] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:17.824541 7805 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: TxnStatusTablet state changed. Reason: New leader f67d6a8edd3446fda7ebf18ef0a4ebb8. Latest consensus state: current_term: 1 leader_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.824983 7805 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:03:17.827227 7803 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.827553 7803 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:03:17.827837 7813 mvcc.cc:205] Tried to move back new op lower bound from 7317224643861434368 to 7317224643612516352. Current Snapshot: MvccSnapshot[applied={T|T < 7317224643861434368 or (T in {7317224643861434368})}]
I20260811 07:03:17.834546 7814 mvcc.cc:205] Tried to move back new op lower bound from 7317224643861434368 to 7317224643612516352. Current Snapshot: MvccSnapshot[applied={T|T < 7317224643861434368}]
I20260811 07:03:17.834962 7805 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.835222 7805 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P d0a07002fe484f898f6feb7612ab6a6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:03:17.840138 7818 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: TxnStatusTablet state changed. Reason: New leader f67d6a8edd3446fda7ebf18ef0a4ebb8. Latest consensus state: current_term: 1 leader_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.840503 7818 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:03:17.842044 7844 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.842340 7844 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P f67d6a8edd3446fda7ebf18ef0a4ebb8: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:03:17.846634 7818 tablet_replica.cc:439] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } } }
I20260811 07:03:17.847004 7818 tablet_replica.cc:442] T a9b4baf4a0ed4c0e884c37b42384c10c P 9f4ee3e354e845b28732ab1e0006bcef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:03:17.868832 7849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.858724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:56561 (local address 127.30.73.67:35061)
0811 07:03:17.858980 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.858987 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.859192 (+ 205us) server_negotiation.cc:407] Connection header received
0811 07:03:17.859507 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.859513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.859606 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.859721 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:17.860356 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.861550 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.863977 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.864873 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.865061 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.867127 (+ 2066us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:17.867355 (+ 228us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:17.867486 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.868296 (+ 810us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.868426 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260811 07:03:17.871044 7854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.858320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:35061 (local address 127.30.73.65:56561)
0811 07:03:17.859070 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.859095 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.859332 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.859751 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.859756 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.859769 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:03:17.860154 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.860166 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.861740 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.861746 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.863756 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.863778 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.865475 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.865503 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.866425 (+ 922us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.866622 (+ 197us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:03:17.867983 (+ 1361us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:03:17.868033 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.868241 (+ 208us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.868515 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":664,"threads_started":1}
I20260811 07:03:17.893179 7541 raft_consensus.cc:1261] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Refusing update from remote peer 9f4ee3e354e845b28732ab1e0006bcef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:17.893195 7700 raft_consensus.cc:1261] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Refusing update from remote peer 9f4ee3e354e845b28732ab1e0006bcef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:17.893875 7806 consensus_queue.cc:1035] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:17.894539 7818 consensus_queue.cc:1035] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:17.906778 7812 mvcc.cc:205] Tried to move back new op lower bound from 7317224644162977792 to 7317224642685804544. Current Snapshot: MvccSnapshot[applied={T|T < 7317224644162977792}]
I20260811 07:03:17.962847 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.953718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:44587 (local address 127.30.73.65:42763)
0811 07:03:17.953964 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:17.953973 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:17.954688 (+ 715us) server_negotiation.cc:407] Connection header received
0811 07:03:17.954908 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:17.954914 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:17.955025 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:17.955123 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:17.956060 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.957682 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.960232 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.960936 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.961054 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.961918 (+ 864us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:17.962065 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:17.962169 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:17.962388 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 07:03:17.962486 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 07:03:17.963347 7863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:17.953696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:42763 (local address 127.30.73.67:44587)
0811 07:03:17.954562 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:17.954585 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:17.954750 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:17.955302 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:17.955307 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:17.955322 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:03:17.955863 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.955878 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.957933 (+ 2055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.957939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.960013 (+ 2074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:17.960033 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:17.961288 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:17.961296 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:17.961563 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:17.961672 (+ 109us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:03:17.962192 (+ 520us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:03:17.962205 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 07:03:17.962358 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 07:03:17.962530 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":427,"threads_started":1}
I20260811 07:03:18.003890 7193 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:18.004169 7193 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:18.008666 7193 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922: Sending DeleteTablet for 3 replicas of tablet 4b3cad7864ad456287b8aaa2febb865b
I20260811 07:03:18.009909 7512 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b3cad7864ad456287b8aaa2febb865b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:18 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:59276
I20260811 07:03:18.009989 7349 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b3cad7864ad456287b8aaa2febb865b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:18 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:46336
I20260811 07:03:18.010792 7677 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b3cad7864ad456287b8aaa2febb865b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:18 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:48804
I20260811 07:03:18.010870 7868 tablet_replica.cc:330] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: stopping tablet replica
I20260811 07:03:18.011634 7868 raft_consensus.cc:2229] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:03:18.012287 7868 raft_consensus.cc:2258] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:18.014250 7868 ts_tablet_manager.cc:1905] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:18.025183 7867 tablet_replica.cc:330] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: stopping tablet replica
I20260811 07:03:18.025439 7867 raft_consensus.cc:2229] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:18.025451 7868 ts_tablet_manager.cc:1918] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:03:18.025802 7868 log.cc:1196] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/4b3cad7864ad456287b8aaa2febb865b
I20260811 07:03:18.025866 7867 raft_consensus.cc:2258] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:18.026948 7868 ts_tablet_manager.cc:1939] T 4b3cad7864ad456287b8aaa2febb865b P 9f4ee3e354e845b28732ab1e0006bcef: Deleting consensus metadata
I20260811 07:03:18.027130 7867 ts_tablet_manager.cc:1905] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:18.028857 7176 catalog_manager.cc:4841] TS 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65:42763): tablet 4b3cad7864ad456287b8aaa2febb865b (table test-table [id=188ca36f7f504f5a9a52b09a5fdcae1a]) successfully deleted
I20260811 07:03:18.030443 7869 tablet_replica.cc:330] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: stopping tablet replica
I20260811 07:03:18.030755 7869 raft_consensus.cc:2229] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:18.031216 7869 raft_consensus.cc:2258] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:18.032750 7869 ts_tablet_manager.cc:1905] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:18.035020 7867 ts_tablet_manager.cc:1918] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:03:18.035188 7867 log.cc:1196] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/4b3cad7864ad456287b8aaa2febb865b
I20260811 07:03:18.035696 7867 ts_tablet_manager.cc:1939] T 4b3cad7864ad456287b8aaa2febb865b P d0a07002fe484f898f6feb7612ab6a6e: Deleting consensus metadata
I20260811 07:03:18.037070 7176 catalog_manager.cc:4841] TS d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855): tablet 4b3cad7864ad456287b8aaa2febb865b (table test-table [id=188ca36f7f504f5a9a52b09a5fdcae1a]) successfully deleted
I20260811 07:03:18.040844 7869 ts_tablet_manager.cc:1918] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:03:18.041072 7869 log.cc:1196] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/4b3cad7864ad456287b8aaa2febb865b
I20260811 07:03:18.041539 7869 ts_tablet_manager.cc:1939] T 4b3cad7864ad456287b8aaa2febb865b P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting consensus metadata
I20260811 07:03:18.042833 7178 catalog_manager.cc:4841] TS f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061): tablet 4b3cad7864ad456287b8aaa2febb865b (table test-table [id=188ca36f7f504f5a9a52b09a5fdcae1a]) successfully deleted
Aug 11 07:03:18 dist-test-slave-69rg krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:03:18 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:18 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:03:18.115373 7629 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:18.095222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42536 (local address 127.30.73.126:35103)
0811 07:03:18.095479 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:18.095486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:18.096070 (+ 584us) server_negotiation.cc:407] Connection header received
0811 07:03:18.096225 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:18.096231 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:18.096340 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:18.096471 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:18.098846 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.100258 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.101988 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.102716 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.102862 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:18.115064 (+ 12202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42536: BlockingRecv error: recv got EOF from 127.0.0.1:42536 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 07:03:18 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM
I20260811 07:03:18.138682 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:18.119378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42540 (local address 127.30.73.126:35103)
0811 07:03:18.119556 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:18.119561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:18.122354 (+ 2793us) server_negotiation.cc:407] Connection header received
0811 07:03:18.122575 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:18.122580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:18.122675 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:18.122797 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:18.124146 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.124924 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.126294 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.126903 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.127082 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:18.132007 (+ 4925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:18.132013 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:18.132017 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:18.132069 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:18.135638 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:18.136473 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:18.136478 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:18.136480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:18.136629 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:18.137081 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:18.137085 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:18.137087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:18.137377 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:18.137667 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:18.138029 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 07:03:18.138295 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:03:18.143870 7193 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:03:18.144609 7193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:03:18.153738 7349 tablet_service.cc:1467] Processing CreateTablet for tablet 91df9d3581b24abb83de4c1df202284a (DEFAULT_TABLE table=test-table [id=64be212299ce4ba2874557b483b48234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:18.154323 7349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91df9d3581b24abb83de4c1df202284a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:18.154883 7512 tablet_service.cc:1467] Processing CreateTablet for tablet 91df9d3581b24abb83de4c1df202284a (DEFAULT_TABLE table=test-table [id=64be212299ce4ba2874557b483b48234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:18.155373 7512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91df9d3581b24abb83de4c1df202284a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:18.161648 7883 tablet_bootstrap.cc:492] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: Bootstrap starting.
I20260811 07:03:18.162165 7677 tablet_service.cc:1467] Processing CreateTablet for tablet 91df9d3581b24abb83de4c1df202284a (DEFAULT_TABLE table=test-table [id=64be212299ce4ba2874557b483b48234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:18.162932 7677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91df9d3581b24abb83de4c1df202284a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:18.163810 7883 tablet_bootstrap.cc:654] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:18.183766 7884 tablet_bootstrap.cc:492] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: Bootstrap starting.
I20260811 07:03:18.184583 7886 tablet_bootstrap.cc:492] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: Bootstrap starting.
I20260811 07:03:18.189771 7886 tablet_bootstrap.cc:654] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:18.202603 7884 tablet_bootstrap.cc:654] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:18.206213 7883 tablet_bootstrap.cc:492] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: No bootstrap required, opened a new log
I20260811 07:03:18.206485 7883 ts_tablet_manager.cc:1397] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: Time spent bootstrapping tablet: real 0.046s user 0.020s sys 0.023s
I20260811 07:03:18.207505 7883 raft_consensus.cc:348] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.207823 7883 raft_consensus.cc:374] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:18.207954 7883 raft_consensus.cc:729] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a07002fe484f898f6feb7612ab6a6e, State: Initialized, Role: FOLLOWER
I20260811 07:03:18.208257 7883 consensus_queue.cc:260] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.209323 7883 ts_tablet_manager.cc:1428] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:18.217624 7884 tablet_bootstrap.cc:492] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: No bootstrap required, opened a new log
I20260811 07:03:18.217913 7884 ts_tablet_manager.cc:1397] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.000s
I20260811 07:03:18.219604 7884 raft_consensus.cc:348] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.220060 7884 raft_consensus.cc:374] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:18.220176 7886 tablet_bootstrap.cc:492] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: No bootstrap required, opened a new log
I20260811 07:03:18.220242 7884 raft_consensus.cc:729] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4ee3e354e845b28732ab1e0006bcef, State: Initialized, Role: FOLLOWER
I20260811 07:03:18.220402 7886 ts_tablet_manager.cc:1397] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.005s
I20260811 07:03:18.220623 7884 consensus_queue.cc:260] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.221306 7884 ts_tablet_manager.cc:1428] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:03:18.221415 7886 raft_consensus.cc:348] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.221674 7886 raft_consensus.cc:374] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:18.221799 7886 raft_consensus.cc:729] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67d6a8edd3446fda7ebf18ef0a4ebb8, State: Initialized, Role: FOLLOWER
I20260811 07:03:18.222128 7886 consensus_queue.cc:260] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.222987 7886 ts_tablet_manager.cc:1428] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 07:03:18.227344 7818 raft_consensus.cc:482] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:03:18.227557 7818 raft_consensus.cc:504] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.228919 7818 leader_election.cc:288] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855), f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061)
I20260811 07:03:18.229781 7700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91df9d3581b24abb83de4c1df202284a" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" is_pre_election: true
I20260811 07:03:18.230105 7700 raft_consensus.cc:2454] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 0.
I20260811 07:03:18.230969 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91df9d3581b24abb83de4c1df202284a" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e" is_pre_election: true
I20260811 07:03:18.231232 7541 raft_consensus.cc:2454] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 0.
I20260811 07:03:18.231928 7294 leader_election.cc:302] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4ee3e354e845b28732ab1e0006bcef, f67d6a8edd3446fda7ebf18ef0a4ebb8; no voters:
I20260811 07:03:18.233134 7818 raft_consensus.cc:2781] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:03:18.233270 7818 raft_consensus.cc:482] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:03:18.233371 7818 raft_consensus.cc:3037] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:18.246897 7818 raft_consensus.cc:504] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.248601 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91df9d3581b24abb83de4c1df202284a" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e"
I20260811 07:03:18.248883 7541 raft_consensus.cc:3037] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:18.250681 7818 leader_election.cc:288] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 election: Requested vote from peers d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855), f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061)
I20260811 07:03:18.251708 7700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91df9d3581b24abb83de4c1df202284a" candidate_uuid: "9f4ee3e354e845b28732ab1e0006bcef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8"
I20260811 07:03:18.251988 7700 raft_consensus.cc:3037] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:18.253234 7541 raft_consensus.cc:2454] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 1.
I20260811 07:03:18.254372 7293 leader_election.cc:302] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4ee3e354e845b28732ab1e0006bcef, d0a07002fe484f898f6feb7612ab6a6e; no voters:
I20260811 07:03:18.255002 7818 raft_consensus.cc:2781] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:18.255615 7818 raft_consensus.cc:686] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 1 LEADER]: Becoming Leader. State: Replica: 9f4ee3e354e845b28732ab1e0006bcef, State: Running, Role: LEADER
I20260811 07:03:18.256026 7818 consensus_queue.cc:237] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.256768 7700 raft_consensus.cc:2454] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4ee3e354e845b28732ab1e0006bcef in term 1.
I20260811 07:03:18.260281 7193 catalog_manager.cc:5495] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65). New cstate: current_term: 1 leader_uuid: "9f4ee3e354e845b28732ab1e0006bcef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } health_report { overall_health: UNKNOWN } } }
I20260811 07:03:18.286386 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:18.279940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46354 (local address 127.30.73.65:42763)
0811 07:03:18.280322 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:18.280329 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:18.280353 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:03:18.280522 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:18.280527 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:18.280596 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:18.280707 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:18.281249 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.282302 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.283650 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.284084 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.284230 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:18.285479 (+ 1249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:18.285617 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:18.285732 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:18.285969 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 07:03:18.286064 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:03:18.289619 7541 raft_consensus.cc:1261] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Refusing update from remote peer 9f4ee3e354e845b28732ab1e0006bcef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:18.289680 7700 raft_consensus.cc:1261] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Refusing update from remote peer 9f4ee3e354e845b28732ab1e0006bcef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:18.290426 7806 consensus_queue.cc:1035] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:18.290947 7818 consensus_queue.cc:1035] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:18.306720 7193 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:18.307037 7193 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:18.313293 7193 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922: Sending DeleteTablet for 3 replicas of tablet 91df9d3581b24abb83de4c1df202284a
I20260811 07:03:18.315290 7512 tablet_service.cc:1514] Processing DeleteTablet for tablet 91df9d3581b24abb83de4c1df202284a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:18 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:59276
I20260811 07:03:18.315901 7867 tablet_replica.cc:330] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: stopping tablet replica
I20260811 07:03:18.315842 7349 tablet_service.cc:1514] Processing DeleteTablet for tablet 91df9d3581b24abb83de4c1df202284a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:18 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:46336
I20260811 07:03:18.316145 7867 raft_consensus.cc:2229] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:18.316219 7868 tablet_replica.cc:330] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: stopping tablet replica
I20260811 07:03:18.316437 7868 raft_consensus.cc:2229] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:03:18.316462 7867 raft_consensus.cc:2258] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:18.316823 7868 raft_consensus.cc:2258] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:18.316751 7677 tablet_service.cc:1514] Processing DeleteTablet for tablet 91df9d3581b24abb83de4c1df202284a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:18 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:48804
I20260811 07:03:18.317178 7869 tablet_replica.cc:330] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: stopping tablet replica
I20260811 07:03:18.317425 7869 raft_consensus.cc:2229] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:18.318186 7869 raft_consensus.cc:2258] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:18.318545 7867 ts_tablet_manager.cc:1905] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:18.321852 7868 ts_tablet_manager.cc:1905] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:18.322659 7193 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:03:18.323570 7193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:03:18.326785 7869 ts_tablet_manager.cc:1905] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:18.331482 7867 ts_tablet_manager.cc:1918] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:18.331677 7867 log.cc:1196] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/91df9d3581b24abb83de4c1df202284a
I20260811 07:03:18.332581 7867 ts_tablet_manager.cc:1939] T 91df9d3581b24abb83de4c1df202284a P d0a07002fe484f898f6feb7612ab6a6e: Deleting consensus metadata
I20260811 07:03:18.334024 7176 catalog_manager.cc:4841] TS d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855): tablet 91df9d3581b24abb83de4c1df202284a (table test-table [id=64be212299ce4ba2874557b483b48234]) successfully deleted
I20260811 07:03:18.336326 7868 ts_tablet_manager.cc:1918] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:18.336524 7868 log.cc:1196] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/91df9d3581b24abb83de4c1df202284a
I20260811 07:03:18.336941 7868 ts_tablet_manager.cc:1939] T 91df9d3581b24abb83de4c1df202284a P 9f4ee3e354e845b28732ab1e0006bcef: Deleting consensus metadata
I20260811 07:03:18.338702 7176 catalog_manager.cc:4841] TS 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65:42763): tablet 91df9d3581b24abb83de4c1df202284a (table test-table [id=64be212299ce4ba2874557b483b48234]) successfully deleted
I20260811 07:03:18.338851 7677 tablet_service.cc:1467] Processing CreateTablet for tablet d3bea0d3e84a4713bf4ad40042bd00db (DEFAULT_TABLE table=test-table [id=15e35cda082b4445bef3b9d5d3ad4b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:18.339664 7677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3bea0d3e84a4713bf4ad40042bd00db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:18.339663 7349 tablet_service.cc:1467] Processing CreateTablet for tablet d3bea0d3e84a4713bf4ad40042bd00db (DEFAULT_TABLE table=test-table [id=15e35cda082b4445bef3b9d5d3ad4b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:18.340087 7349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3bea0d3e84a4713bf4ad40042bd00db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:18.340227 7512 tablet_service.cc:1467] Processing CreateTablet for tablet d3bea0d3e84a4713bf4ad40042bd00db (DEFAULT_TABLE table=test-table [id=15e35cda082b4445bef3b9d5d3ad4b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:18.340663 7512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3bea0d3e84a4713bf4ad40042bd00db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:18.343356 7869 ts_tablet_manager.cc:1918] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:18.343622 7869 log.cc:1196] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/91df9d3581b24abb83de4c1df202284a
I20260811 07:03:18.344278 7869 ts_tablet_manager.cc:1939] T 91df9d3581b24abb83de4c1df202284a P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting consensus metadata
I20260811 07:03:18.345788 7178 catalog_manager.cc:4841] TS f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061): tablet 91df9d3581b24abb83de4c1df202284a (table test-table [id=64be212299ce4ba2874557b483b48234]) successfully deleted
I20260811 07:03:18.348124 7886 tablet_bootstrap.cc:492] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: Bootstrap starting.
I20260811 07:03:18.348169 7883 tablet_bootstrap.cc:492] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: Bootstrap starting.
I20260811 07:03:18.350009 7883 tablet_bootstrap.cc:654] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:18.350556 7886 tablet_bootstrap.cc:654] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:18.354744 7884 tablet_bootstrap.cc:492] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: Bootstrap starting.
I20260811 07:03:18.358022 7884 tablet_bootstrap.cc:654] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:18.359380 7886 tablet_bootstrap.cc:492] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: No bootstrap required, opened a new log
I20260811 07:03:18.359771 7886 ts_tablet_manager.cc:1397] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260811 07:03:18.360821 7886 raft_consensus.cc:348] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.363682 7886 raft_consensus.cc:374] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:18.364215 7886 raft_consensus.cc:729] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67d6a8edd3446fda7ebf18ef0a4ebb8, State: Initialized, Role: FOLLOWER
I20260811 07:03:18.364825 7886 consensus_queue.cc:260] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.366977 7886 ts_tablet_manager.cc:1428] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260811 07:03:18.369130 7883 tablet_bootstrap.cc:492] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: No bootstrap required, opened a new log
I20260811 07:03:18.369580 7883 ts_tablet_manager.cc:1397] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.011s
I20260811 07:03:18.370687 7883 raft_consensus.cc:348] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.371309 7883 raft_consensus.cc:374] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:18.371420 7883 raft_consensus.cc:729] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a07002fe484f898f6feb7612ab6a6e, State: Initialized, Role: FOLLOWER
I20260811 07:03:18.371987 7883 consensus_queue.cc:260] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.373287 7883 ts_tablet_manager.cc:1428] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 07:03:18.373910 7884 tablet_bootstrap.cc:492] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: No bootstrap required, opened a new log
I20260811 07:03:18.375114 7884 ts_tablet_manager.cc:1397] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.007s
I20260811 07:03:18.375947 7884 raft_consensus.cc:348] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.376187 7884 raft_consensus.cc:374] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:18.376294 7884 raft_consensus.cc:729] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4ee3e354e845b28732ab1e0006bcef, State: Initialized, Role: FOLLOWER
I20260811 07:03:18.377318 7884 consensus_queue.cc:260] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.380841 7884 ts_tablet_manager.cc:1428] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260811 07:03:18.487933 7844 raft_consensus.cc:482] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:03:18.488159 7844 raft_consensus.cc:504] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.488749 7844 leader_election.cc:288] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65:42763), d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855)
I20260811 07:03:18.490139 7370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3bea0d3e84a4713bf4ad40042bd00db" candidate_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4ee3e354e845b28732ab1e0006bcef" is_pre_election: true
I20260811 07:03:18.490449 7370 raft_consensus.cc:2454] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f67d6a8edd3446fda7ebf18ef0a4ebb8 in term 0.
I20260811 07:03:18.490485 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3bea0d3e84a4713bf4ad40042bd00db" candidate_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e" is_pre_election: true
I20260811 07:03:18.490760 7541 raft_consensus.cc:2454] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f67d6a8edd3446fda7ebf18ef0a4ebb8 in term 0.
I20260811 07:03:18.491283 7615 leader_election.cc:302] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4ee3e354e845b28732ab1e0006bcef, f67d6a8edd3446fda7ebf18ef0a4ebb8; no voters:
I20260811 07:03:18.491590 7844 raft_consensus.cc:2781] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:03:18.491709 7844 raft_consensus.cc:482] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:03:18.491881 7844 raft_consensus.cc:3037] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:18.494091 7844 raft_consensus.cc:504] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.494927 7844 leader_election.cc:288] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [CANDIDATE]: Term 1 election: Requested vote from peers 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65:42763), d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855)
I20260811 07:03:18.495651 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3bea0d3e84a4713bf4ad40042bd00db" candidate_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a07002fe484f898f6feb7612ab6a6e"
I20260811 07:03:18.495877 7541 raft_consensus.cc:3037] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:18.496105 7370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3bea0d3e84a4713bf4ad40042bd00db" candidate_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4ee3e354e845b28732ab1e0006bcef"
I20260811 07:03:18.496366 7370 raft_consensus.cc:3037] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:18.498198 7541 raft_consensus.cc:2454] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f67d6a8edd3446fda7ebf18ef0a4ebb8 in term 1.
I20260811 07:03:18.498898 7615 leader_election.cc:302] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0a07002fe484f898f6feb7612ab6a6e, f67d6a8edd3446fda7ebf18ef0a4ebb8; no voters:
I20260811 07:03:18.499213 7844 raft_consensus.cc:2781] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:18.499712 7844 raft_consensus.cc:686] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 LEADER]: Becoming Leader. State: Replica: f67d6a8edd3446fda7ebf18ef0a4ebb8, State: Running, Role: LEADER
I20260811 07:03:18.500008 7370 raft_consensus.cc:2454] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f67d6a8edd3446fda7ebf18ef0a4ebb8 in term 1.
I20260811 07:03:18.500171 7844 consensus_queue.cc:237] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } }
I20260811 07:03:18.503696 7194 catalog_manager.cc:5495] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f67d6a8edd3446fda7ebf18ef0a4ebb8" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 35061 } health_report { overall_health: HEALTHY } } }
I20260811 07:03:18.529361 7901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:18.523754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48808 (local address 127.30.73.67:35061)
0811 07:03:18.524270 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:18.524275 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:18.524291 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:03:18.524359 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:18.524362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:18.524425 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:18.524514 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:18.524951 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.525881 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.527248 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.527664 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.527764 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:18.528346 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:18.528454 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:18.528527 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:18.528848 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 07:03:18.528935 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":281,"threads_started":1}
I20260811 07:03:18.548235 7901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:18.540623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:33067 (local address 127.30.73.67:35061)
0811 07:03:18.540889 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:18.540897 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:18.541337 (+ 440us) server_negotiation.cc:407] Connection header received
0811 07:03:18.541731 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:18.541742 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:18.541866 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:18.541981 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:18.542656 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.543995 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.545951 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.546611 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.546792 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:18.547185 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:18.547429 (+ 244us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:18.547567 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:18.547698 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 07:03:18.547855 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":85}
I20260811 07:03:18.548295 7904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:18.540183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:35061 (local address 127.30.73.67:33067)
0811 07:03:18.541221 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:18.541241 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:18.541510 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:18.541993 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:18.541998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:18.542010 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:03:18.542293 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:18.542303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.544142 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.544150 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:18.545624 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:18.545638 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.546814 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.546820 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:18.546958 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:18.546997 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:03:18.547556 (+ 559us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:03:18.547567 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:03:18.547678 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:03:18.547923 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":921,"mutex_wait_us":39,"thread_start_us":659,"threads_started":1}
I20260811 07:03:18.557718 7541 raft_consensus.cc:1261] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Refusing update from remote peer f67d6a8edd3446fda7ebf18ef0a4ebb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:18.557718 7370 raft_consensus.cc:1261] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Refusing update from remote peer f67d6a8edd3446fda7ebf18ef0a4ebb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:18.558435 7844 consensus_queue.cc:1035] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4ee3e354e845b28732ab1e0006bcef" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 42763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:18.558820 7898 consensus_queue.cc:1035] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a07002fe484f898f6feb7612ab6a6e" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:18.615235 7194 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:18.615509 7194 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:18.619395 7194 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 732bfe76b4f848e0a5bb21086e7fa922: Sending DeleteTablet for 3 replicas of tablet d3bea0d3e84a4713bf4ad40042bd00db
I20260811 07:03:18.620481 7512 tablet_service.cc:1514] Processing DeleteTablet for tablet d3bea0d3e84a4713bf4ad40042bd00db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:18 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:59276
I20260811 07:03:18.620683 7349 tablet_service.cc:1514] Processing DeleteTablet for tablet d3bea0d3e84a4713bf4ad40042bd00db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:18 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:46336
I20260811 07:03:18.620934 7867 tablet_replica.cc:330] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: stopping tablet replica
I20260811 07:03:18.621024 7868 tablet_replica.cc:330] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: stopping tablet replica
I20260811 07:03:18.621130 7867 raft_consensus.cc:2229] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:18.621204 7868 raft_consensus.cc:2229] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:18.621501 7867 raft_consensus.cc:2258] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:18.621567 7868 raft_consensus.cc:2258] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:18.621969 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 7277
I20260811 07:03:18.622484 7677 tablet_service.cc:1514] Processing DeleteTablet for tablet d3bea0d3e84a4713bf4ad40042bd00db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:18 UTC) from {username='oryx', principal='oryx/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:48804
I20260811 07:03:18.623354 7869 tablet_replica.cc:330] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: stopping tablet replica
I20260811 07:03:18.623574 7869 raft_consensus.cc:2229] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:03:18.623889 7867 ts_tablet_manager.cc:1905] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:18.624152 7869 raft_consensus.cc:2258] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:18.626205 7868 ts_tablet_manager.cc:1905] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:18.627324 7869 ts_tablet_manager.cc:1905] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:18.633498 7868 ts_tablet_manager.cc:1918] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:03:18.633757 7868 log.cc:1196] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/d3bea0d3e84a4713bf4ad40042bd00db
I20260811 07:03:18.634707 7868 ts_tablet_manager.cc:1939] T d3bea0d3e84a4713bf4ad40042bd00db P 9f4ee3e354e845b28732ab1e0006bcef: Deleting consensus metadata
I20260811 07:03:18.636279 7176 catalog_manager.cc:4841] TS 9f4ee3e354e845b28732ab1e0006bcef (127.30.73.65:42763): tablet d3bea0d3e84a4713bf4ad40042bd00db (table test-table [id=15e35cda082b4445bef3b9d5d3ad4b93]) successfully deleted
I20260811 07:03:18.639580 7867 ts_tablet_manager.cc:1918] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:03:18.639820 7867 log.cc:1196] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/d3bea0d3e84a4713bf4ad40042bd00db
I20260811 07:03:18.640304 7867 ts_tablet_manager.cc:1939] T d3bea0d3e84a4713bf4ad40042bd00db P d0a07002fe484f898f6feb7612ab6a6e: Deleting consensus metadata
I20260811 07:03:18.640925 7869 ts_tablet_manager.cc:1918] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:03:18.641139 7869 log.cc:1196] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/d3bea0d3e84a4713bf4ad40042bd00db
I20260811 07:03:18.641635 7869 ts_tablet_manager.cc:1939] T d3bea0d3e84a4713bf4ad40042bd00db P f67d6a8edd3446fda7ebf18ef0a4ebb8: Deleting consensus metadata
I20260811 07:03:18.642343 7176 catalog_manager.cc:4841] TS d0a07002fe484f898f6feb7612ab6a6e (127.30.73.66:32855): tablet d3bea0d3e84a4713bf4ad40042bd00db (table test-table [id=15e35cda082b4445bef3b9d5d3ad4b93]) successfully deleted
I20260811 07:03:18.642990 7178 catalog_manager.cc:4841] TS f67d6a8edd3446fda7ebf18ef0a4ebb8 (127.30.73.67:35061): tablet d3bea0d3e84a4713bf4ad40042bd00db (table test-table [id=15e35cda082b4445bef3b9d5d3ad4b93]) successfully deleted
Aug 11 07:03:18 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.65@KRBTEST.COM
I20260811 07:03:18.653904 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:18.626150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46370 (local address 127.30.73.65:42763)
0811 07:03:18.626363 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:18.626370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:18.633944 (+ 7574us) server_negotiation.cc:407] Connection header received
0811 07:03:18.634190 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:18.634198 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:18.634323 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:18.634451 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:18.636227 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.637398 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.639863 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.640509 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.640624 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:18.646072 (+ 5448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:18.646094 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:18.646118 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:18.646170 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:18.650169 (+ 3999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:18.651095 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:18.651107 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:18.651111 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:18.651288 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:18.651683 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:18.651689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:18.651693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:18.652193 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:18.652520 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:18.652904 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 07:03:18.653271 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:03:18.655349 7421 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:18.845079 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 7277
I20260811 07:03:18.876703 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 7434
Aug 11 07:03:18 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.66@KRBTEST.COM
I20260811 07:03:18.894850 7912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:18.877640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59282 (local address 127.30.73.66:32855)
0811 07:03:18.878204 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:18.878209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:18.878224 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:03:18.878278 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:18.878282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:18.878356 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:18.878483 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:18.879771 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.880547 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.881938 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:18.882404 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:18.882557 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:18.888126 (+ 5569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:18.888150 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:18.888175 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:18.888236 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:18.891601 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:18.892449 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:18.892458 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:18.892460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:18.892607 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:18.893016 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:18.893021 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:18.893027 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:18.893430 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:18.893759 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:18.894140 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 07:03:18.894439 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":315,"threads_started":1}
I20260811 07:03:18.895581 7584 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:19.010462 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 7434
I20260811 07:03:19.049533 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 7597
Aug 11 07:03:19 dist-test-slave-69rg krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.73.67@KRBTEST.COM
I20260811 07:03:19.074472 7916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:19.050583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48816 (local address 127.30.73.67:35061)
0811 07:03:19.051435 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:19.051442 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:19.051465 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:03:19.051537 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:19.051543 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:19.051645 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:19.051803 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:19.053279 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:19.054898 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:19.056643 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:19.057599 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:19.057782 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:19.063575 (+ 5793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:19.063601 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:19.063632 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:19.063715 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:19.069670 (+ 5955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:19.070894 (+ 1224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:19.070908 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:19.070912 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:19.071128 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:19.071773 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:19.071779 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:19.071782 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:19.072427 (+ 645us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:19.072833 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:19.073621 (+ 788us) server_negotiation.cc:299] Negotiation successful
0811 07:03:19.073957 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":597,"threads_started":1}
I20260811 07:03:19.075515 7754 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:19.262086 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 7597
I20260811 07:03:19.295554 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 7156
I20260811 07:03:19.297264 7240 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:19.439143 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 7156
2026-08-11T07:03:19Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (8974 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:03:19 dist-test-slave-69rg krb5kdc[7921](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:03:19 dist-test-slave-69rg krb5kdc[7921](info): set up 2 sockets
Aug 11 07:03:19 dist-test-slave-69rg krb5kdc[7921](info): commencing operation
krb5kdc: starting...
W20260811 07:03:20.830442 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.001s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:03:21 dist-test-slave-69rg krb5kdc[7921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:03:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:03:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:03:21.241358 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:32897
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:37877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:32897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:21.682338 7938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:21.682709 7938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:21.682875 7938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:21.691308 7938 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:21.691469 7938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:21.691521 7938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:21.691659 7938 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:21.691742 7938 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:21.703644 7938 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:37877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:32897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:32897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:21.705683 7938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:21.707212 7938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:21.723814 7945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:21.723953 7943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:21.723927 7948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:21.724270 7938 server_base.cc:1034] running on GCE node
I20260811 07:03:21.725353 7938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:21.727141 7938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:21.728415 7938 hybrid_clock.cc:648] HybridClock initialized: now 1786431801728350 us; error 57 us; skew 500 ppm
I20260811 07:03:21.728842 7938 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T07:03:21Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2349 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:03:21 dist-test-slave-69rg krb5kdc[7954](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:03:21 dist-test-slave-69rg krb5kdc[7954](info): set up 2 sockets
Aug 11 07:03:21 dist-test-slave-69rg krb5kdc[7954](info): commencing operation
krb5kdc: starting...
W20260811 07:03:23.091801 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.006s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:03:23 dist-test-slave-69rg krb5kdc[7954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:03:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:03:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:03:23.415241 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:43655
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:43655
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:23.811756 7969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:23.812070 7969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:23.812163 7969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:23.819912 7969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:23.820042 7969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:23.820096 7969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:23.820170 7969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:23.820222 7969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:23.830605 7969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:43655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:43655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:23.832018 7969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:23.833362 7969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:23.845990 7977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:23.846072 7978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:23.846122 7980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:23.846868 7969 server_base.cc:1034] running on GCE node
I20260811 07:03:23.847744 7969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:23.849704 7969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:23.851150 7969 hybrid_clock.cc:648] HybridClock initialized: now 1786431803851088 us; error 44 us; skew 500 ppm
I20260811 07:03:23.851562 7969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:23 dist-test-slave-69rg krb5kdc[7954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431803, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:23.864037 7969 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:03:23.866050 7969 webserver.cc:460] Webserver started at http://127.30.73.126:36007/ using document root <none> and password file <none>
I20260811 07:03:23.866843 7969 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:23.867007 7969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:23.867363 7969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:23.870735 7969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "f309a73725c741fa818df2ec1e5dc623"
format_stamp: "Formatted at 2026-08-11 07:03:23 on dist-test-slave-69rg"
server_key: "fa8e3b810a6a2466fd676cda0cc0eb84"
server_key_iv: "3793d79c7899f9ae47d878236410b917"
server_key_version: "encryptionkey@0"
I20260811 07:03:23.871531 7969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "f309a73725c741fa818df2ec1e5dc623"
format_stamp: "Formatted at 2026-08-11 07:03:23 on dist-test-slave-69rg"
server_key: "fa8e3b810a6a2466fd676cda0cc0eb84"
server_key_iv: "3793d79c7899f9ae47d878236410b917"
server_key_version: "encryptionkey@0"
I20260811 07:03:23.877511 7969 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 07:03:23.881992 7988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:23.883445 7969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:23.883658 7969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "f309a73725c741fa818df2ec1e5dc623"
format_stamp: "Formatted at 2026-08-11 07:03:23 on dist-test-slave-69rg"
server_key: "fa8e3b810a6a2466fd676cda0cc0eb84"
server_key_iv: "3793d79c7899f9ae47d878236410b917"
server_key_version: "encryptionkey@0"
I20260811 07:03:23.883888 7969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:23.901989 7969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:23.907140 7969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:23.907477 7969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:23.931751 7969 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:43655
I20260811 07:03:23.931810 8045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:43655 every 8 connection(s)
I20260811 07:03:23.933243 7969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:03:23.937736 8046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:23.940835 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 7969
I20260811 07:03:23.941054 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:03:23.941941 31013 external_mini_cluster.cc:1428] Setting key d0a411ab20400e4cd74d46f026eac1ae
I20260811 07:03:23.951593 8046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: Bootstrap starting.
I20260811 07:03:23.955755 8046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:23.957209 8046 log.cc:824] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:03:23 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:03:23.960661 8046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: No bootstrap required, opened a new log
I20260811 07:03:23.967185 8049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:23.944104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59100 (local address 127.30.73.126:43655)
0811 07:03:23.944948 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:23.944960 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:23.945002 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:03:23.946903 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:23.946927 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:23.947331 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:23.947659 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:23.949588 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:23.951286 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:23.953302 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:23.954240 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:23.954414 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:23.959378 (+ 4964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:23.959387 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:23.959404 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:23.959442 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:23.962988 (+ 3546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:23.963769 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:23.963776 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:23.963786 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:23.963958 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:23.964345 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:23.964360 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:23.964363 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:23.964891 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:23.965281 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:23.965669 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 07:03:23.966142 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":398,"threads_started":1}
I20260811 07:03:23.969537 8046 raft_consensus.cc:348] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } }
I20260811 07:03:23.970014 8046 raft_consensus.cc:374] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:23.970135 8046 raft_consensus.cc:729] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f309a73725c741fa818df2ec1e5dc623, State: Initialized, Role: FOLLOWER
I20260811 07:03:23.970827 8046 consensus_queue.cc:260] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } }
I20260811 07:03:23.971086 8046 raft_consensus.cc:388] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:03:23.971252 8046 raft_consensus.cc:482] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:03:23.971429 8046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:23.973610 8046 raft_consensus.cc:504] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } }
I20260811 07:03:23.974138 8046 leader_election.cc:302] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f309a73725c741fa818df2ec1e5dc623; no voters:
I20260811 07:03:23.974751 8046 leader_election.cc:288] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:03:23.974898 8051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:23.976244 8051 raft_consensus.cc:686] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 1 LEADER]: Becoming Leader. State: Replica: f309a73725c741fa818df2ec1e5dc623, State: Running, Role: LEADER
I20260811 07:03:23.976750 8051 consensus_queue.cc:237] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } }
I20260811 07:03:23.977038 8046 sys_catalog.cc:564] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:03:23.979990 8053 sys_catalog.cc:455] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f309a73725c741fa818df2ec1e5dc623. Latest consensus state: current_term: 1 leader_uuid: "f309a73725c741fa818df2ec1e5dc623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } } }
I20260811 07:03:23.979957 8052 sys_catalog.cc:455] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f309a73725c741fa818df2ec1e5dc623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } } }
I20260811 07:03:23.980432 8053 sys_catalog.cc:458] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:23.980445 8052 sys_catalog.cc:458] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:23.983733 8063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:03:23.988173 8063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:03:23.998354 8063 catalog_manager.cc:1347] Generated new cluster ID: 2182c222469841a9a0d8db5568552b3b
I20260811 07:03:23.998504 8063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:03:24.040457 8063 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:03:24.042837 8063 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:03:24.052979 8063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: Generated new TSK 0
I20260811 07:03:24.054018 8063 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:03:24.131400 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:43655
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:24.504630 8077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:24.504933 8077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:24.505103 8077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:24.512398 8077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:24.512595 8077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:24.512789 8077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:03:24.522926 8077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:43655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:24.524307 8077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:24.525676 8077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:24.539703 8083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:24.539623 8086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:24.539808 8084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:24.540925 8077 server_base.cc:1034] running on GCE node
I20260811 07:03:24.541712 8077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:24.542850 8077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:24.544108 8077 hybrid_clock.cc:648] HybridClock initialized: now 1786431804544049 us; error 52 us; skew 500 ppm
I20260811 07:03:24.544495 8077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:24 dist-test-slave-69rg krb5kdc[7954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431804, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:24.548041 8077 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:03:24.549667 8077 webserver.cc:460] Webserver started at http://127.30.73.65:43819/ using document root <none> and password file <none>
I20260811 07:03:24.550449 8077 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:24.550601 8077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:24.550935 8077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:24.554494 8077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "3114f07867ed4108b6ee5566b442d069"
format_stamp: "Formatted at 2026-08-11 07:03:24 on dist-test-slave-69rg"
server_key: "a5bcf67344c31e44bdcb8d748462f362"
server_key_iv: "60eecdc2c9fb32a89e4105d3fd00c4de"
server_key_version: "encryptionkey@0"
I20260811 07:03:24.555469 8077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "3114f07867ed4108b6ee5566b442d069"
format_stamp: "Formatted at 2026-08-11 07:03:24 on dist-test-slave-69rg"
server_key: "a5bcf67344c31e44bdcb8d748462f362"
server_key_iv: "60eecdc2c9fb32a89e4105d3fd00c4de"
server_key_version: "encryptionkey@0"
I20260811 07:03:24.560984 8077 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:03:24.564823 8094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:24.566396 8077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:24.566592 8077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "3114f07867ed4108b6ee5566b442d069"
format_stamp: "Formatted at 2026-08-11 07:03:24 on dist-test-slave-69rg"
server_key: "a5bcf67344c31e44bdcb8d748462f362"
server_key_iv: "60eecdc2c9fb32a89e4105d3fd00c4de"
server_key_version: "encryptionkey@0"
I20260811 07:03:24.566808 8077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:24.619346 8077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:24.624059 8077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:24.624370 8077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:24.625445 8077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:24.626941 8077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:24.627055 8077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:24.627218 8077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:24.627295 8077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:24.664526 8077 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:33441
I20260811 07:03:24.664587 8226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:33441 every 8 connection(s)
I20260811 07:03:24.665916 8077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:03:24.674363 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 8077
I20260811 07:03:24.674571 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:03:24.675297 31013 external_mini_cluster.cc:1428] Setting key 8f96dc596ee9346e97e1a75eae48d948
Aug 11 07:03:24 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431804, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:03:24.690240 8231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:24.668840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:48227 (local address 127.30.73.126:43655)
0811 07:03:24.669337 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:24.669342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:24.670404 (+ 1062us) server_negotiation.cc:407] Connection header received
0811 07:03:24.672314 (+ 1910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:24.672321 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:24.672407 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:24.672539 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:24.674111 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:24.675048 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:24.677282 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:24.677913 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:24.678055 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:24.682322 (+ 4267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:24.682331 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:24.682338 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:24.682386 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:24.686214 (+ 3828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:24.687122 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:24.687130 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:24.687136 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:24.687292 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:24.687982 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:24.687990 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:24.687996 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:24.688413 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:24.688632 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:24.689708 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0811 07:03:24.689971 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":230,"threads_started":1}
I20260811 07:03:24.691962 8232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:24.669455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:48227)
0811 07:03:24.670244 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:24.670290 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:24.672045 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:24.672776 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:24.672784 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:24.673281 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:24.673899 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:24.673935 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:24.675230 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:24.675236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:24.677111 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:24.677127 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:24.678174 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:24.678184 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:24.678450 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:24.679404 (+ 954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:24.679429 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:24.682066 (+ 2637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:24.686397 (+ 4331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:24.686405 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:24.686422 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:24.686962 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:24.687579 (+ 617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:24.687588 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:24.687595 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:24.687841 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:24.688583 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:24.688596 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:24.689158 (+ 562us) client_negotiation.cc:769] Sending connection context
0811 07:03:24.689588 (+ 430us) client_negotiation.cc:240] Negotiation successful
0811 07:03:24.690327 (+ 739us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":350,"threads_started":1}
I20260811 07:03:24.693756 8229 heartbeater.cc:347] Connected to a master server at 127.30.73.126:43655
I20260811 07:03:24.694157 8229 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:24.694952 8229 heartbeater.cc:511] Master 127.30.73.126:43655 requested a full tablet report, sending...
I20260811 07:03:24.697216 8009 ts_manager.cc:194] Registered new tserver with Master: 3114f07867ed4108b6ee5566b442d069 (127.30.73.65:33441)
I20260811 07:03:24.698810 8009 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:48227
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:03:24.745810 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:43655
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:25.130986 8235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:25.131517 8235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:25.131716 8235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:25.140336 8235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:25.140555 8235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:25.140765 8235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:03:25.152254 8235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:43655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:25.153785 8235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:25.155287 8235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:25.170622 8240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:25.170528 8243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:25.170599 8241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:25.171525 8235 server_base.cc:1034] running on GCE node
I20260811 07:03:25.172216 8235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:25.173391 8235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:25.174650 8235 hybrid_clock.cc:648] HybridClock initialized: now 1786431805174599 us; error 40 us; skew 500 ppm
I20260811 07:03:25.175087 8235 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:25 dist-test-slave-69rg krb5kdc[7954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431805, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:25.178889 8235 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:03:25.180783 8235 webserver.cc:460] Webserver started at http://127.30.73.66:38667/ using document root <none> and password file <none>
I20260811 07:03:25.181622 8235 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:25.181766 8235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:25.182209 8235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:25.185487 8235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "36d89b6a397042ac85ea666abc1b6183"
format_stamp: "Formatted at 2026-08-11 07:03:25 on dist-test-slave-69rg"
server_key: "ec6bfebe51e970d821c754daefe2a0f1"
server_key_iv: "b06f8aba03fc94e76c9dac4c7d832d96"
server_key_version: "encryptionkey@0"
I20260811 07:03:25.186520 8235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "36d89b6a397042ac85ea666abc1b6183"
format_stamp: "Formatted at 2026-08-11 07:03:25 on dist-test-slave-69rg"
server_key: "ec6bfebe51e970d821c754daefe2a0f1"
server_key_iv: "b06f8aba03fc94e76c9dac4c7d832d96"
server_key_version: "encryptionkey@0"
I20260811 07:03:25.192977 8235 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 07:03:25.197554 8250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:25.199371 8235 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260811 07:03:25.199610 8235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "36d89b6a397042ac85ea666abc1b6183"
format_stamp: "Formatted at 2026-08-11 07:03:25 on dist-test-slave-69rg"
server_key: "ec6bfebe51e970d821c754daefe2a0f1"
server_key_iv: "b06f8aba03fc94e76c9dac4c7d832d96"
server_key_version: "encryptionkey@0"
I20260811 07:03:25.199891 8235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:25.231564 8235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:25.236840 8235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:25.237222 8235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:25.238442 8235 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:25.240087 8235 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:25.240207 8235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:25.240388 8235 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:25.240473 8235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:25.285030 8235 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:38629
I20260811 07:03:25.285173 8380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:38629 every 8 connection(s)
I20260811 07:03:25.286612 8235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:03:25.290369 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 8235
I20260811 07:03:25.290578 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:03:25.291239 31013 external_mini_cluster.cc:1428] Setting key c641d4947bc35af20bed7ef0c5c88adb
Aug 11 07:03:25 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431805, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:03:25.312606 8384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:25.289885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:54081 (local address 127.30.73.126:43655)
0811 07:03:25.290486 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:25.290494 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:25.291810 (+ 1316us) server_negotiation.cc:407] Connection header received
0811 07:03:25.294562 (+ 2752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:25.294568 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:25.294667 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:25.294794 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:25.297108 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:25.297927 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:25.300007 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:25.300801 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:25.301264 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:25.305616 (+ 4352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:25.305621 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:25.305625 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:25.305663 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:25.308619 (+ 2956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:25.309766 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:25.309774 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:25.309778 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:25.309987 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:25.310491 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:25.310498 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:25.310501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:25.310834 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:25.311006 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:25.311952 (+ 946us) server_negotiation.cc:299] Negotiation successful
0811 07:03:25.312226 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":349,"threads_started":1}
I20260811 07:03:25.313747 8385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:25.290595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:54081)
0811 07:03:25.291638 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:25.291681 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:25.294270 (+ 2589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:25.295086 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:25.295095 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:25.295803 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:25.296641 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:25.296676 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:25.298106 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:25.298114 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:25.299812 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:25.299828 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:25.301394 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:25.301408 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:25.301692 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:25.302673 (+ 981us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:25.302698 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:25.305309 (+ 2611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:25.308818 (+ 3509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:25.308828 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:25.308848 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:25.309522 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:25.310122 (+ 600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:25.310129 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:25.310133 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:25.310365 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:25.310994 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:25.311003 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:25.311412 (+ 409us) client_negotiation.cc:769] Sending connection context
0811 07:03:25.311849 (+ 437us) client_negotiation.cc:240] Negotiation successful
0811 07:03:25.312457 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":376,"threads_started":1}
I20260811 07:03:25.315908 8381 heartbeater.cc:347] Connected to a master server at 127.30.73.126:43655
I20260811 07:03:25.316264 8381 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:25.317098 8381 heartbeater.cc:511] Master 127.30.73.126:43655 requested a full tablet report, sending...
I20260811 07:03:25.318790 8009 ts_manager.cc:194] Registered new tserver with Master: 36d89b6a397042ac85ea666abc1b6183 (127.30.73.66:38629)
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
I20260811 07:03:25.319742 8009 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:54081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:03:25.363092 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:43655
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:03:25.702116 8229 heartbeater.cc:503] Master 127.30.73.126:43655 was elected leader, sending a full tablet report...
W20260811 07:03:25.723351 8388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:25.723682 8388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:25.723856 8388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:25.731215 8388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:25.731374 8388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:25.731564 8388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:03:25.741562 8388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:43655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:25.743007 8388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:25.744354 8388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:25.758448 8397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:25.758549 8394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:25.758551 8395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:25.759840 8388 server_base.cc:1034] running on GCE node
I20260811 07:03:25.760493 8388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:25.761516 8388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:25.762789 8388 hybrid_clock.cc:648] HybridClock initialized: now 1786431805762719 us; error 50 us; skew 500 ppm
I20260811 07:03:25.763163 8388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:25 dist-test-slave-69rg krb5kdc[7954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431805, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:25.766636 8388 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:03:25.768241 8388 webserver.cc:460] Webserver started at http://127.30.73.67:33721/ using document root <none> and password file <none>
I20260811 07:03:25.768965 8388 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:25.769126 8388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:25.769462 8388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:25.772897 8388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "575ef8eb32204652b446075b13fdc5a5"
format_stamp: "Formatted at 2026-08-11 07:03:25 on dist-test-slave-69rg"
server_key: "5770307e6713ad9f852608ae8f37783d"
server_key_iv: "373ff61763474176cb4a8be360bb0974"
server_key_version: "encryptionkey@0"
I20260811 07:03:25.773784 8388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "575ef8eb32204652b446075b13fdc5a5"
format_stamp: "Formatted at 2026-08-11 07:03:25 on dist-test-slave-69rg"
server_key: "5770307e6713ad9f852608ae8f37783d"
server_key_iv: "373ff61763474176cb4a8be360bb0974"
server_key_version: "encryptionkey@0"
I20260811 07:03:25.779366 8388 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 07:03:25.783126 8404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:25.784601 8388 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:03:25.784807 8388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "575ef8eb32204652b446075b13fdc5a5"
format_stamp: "Formatted at 2026-08-11 07:03:25 on dist-test-slave-69rg"
server_key: "5770307e6713ad9f852608ae8f37783d"
server_key_iv: "373ff61763474176cb4a8be360bb0974"
server_key_version: "encryptionkey@0"
I20260811 07:03:25.785045 8388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:25.803545 8388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:25.807956 8388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:25.808281 8388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:25.809504 8388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:25.811050 8388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:25.811165 8388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:25.811327 8388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:25.811407 8388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:25.847949 8388 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:34777
I20260811 07:03:25.848102 8534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:34777 every 8 connection(s)
I20260811 07:03:25.849419 8388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:03:25.854107 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 8388
I20260811 07:03:25.854321 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:03:25.854925 31013 external_mini_cluster.cc:1428] Setting key 7d5a1a544d3987b5af0c2284a51d5217
Aug 11 07:03:25 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431805, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:03:25.873061 8537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:25.852515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:45811 (local address 127.30.73.126:43655)
0811 07:03:25.853047 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:25.853056 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:25.855534 (+ 2478us) server_negotiation.cc:407] Connection header received
0811 07:03:25.856901 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:25.856905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:25.857042 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:25.857178 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:25.859095 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:25.859978 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:25.861598 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:25.862157 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:25.862270 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:25.866092 (+ 3822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:25.866098 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:25.866102 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:25.866138 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:25.869093 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:25.870232 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:25.870238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:25.870241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:25.870422 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:25.871058 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:25.871062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:25.871064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:25.871404 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:25.871574 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:25.872430 (+ 856us) server_negotiation.cc:299] Negotiation successful
0811 07:03:25.872669 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":257,"threads_started":1}
I20260811 07:03:25.874140 8539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:25.853111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:45811)
0811 07:03:25.854133 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:25.854203 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:25.856540 (+ 2337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:25.857478 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:25.857487 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:25.858132 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:25.858923 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:25.858944 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:25.860155 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:25.860159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:25.861431 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:25.861444 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:25.862388 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:25.862394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:25.862612 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:25.863359 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:25.863394 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:25.865775 (+ 2381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:25.869283 (+ 3508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:25.869291 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:25.869307 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:25.870040 (+ 733us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:25.870587 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:25.870592 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:25.870619 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:25.870899 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:25.871550 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:25.871558 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:25.872015 (+ 457us) client_negotiation.cc:769] Sending connection context
0811 07:03:25.872302 (+ 287us) client_negotiation.cc:240] Negotiation successful
0811 07:03:25.872883 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":405,"threads_started":1}
I20260811 07:03:25.875660 8535 heartbeater.cc:347] Connected to a master server at 127.30.73.126:43655
I20260811 07:03:25.876034 8535 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:25.876868 8535 heartbeater.cc:511] Master 127.30.73.126:43655 requested a full tablet report, sending...
I20260811 07:03:25.878646 8009 ts_manager.cc:194] Registered new tserver with Master: 575ef8eb32204652b446075b13fdc5a5 (127.30.73.67:34777)
I20260811 07:03:25.879513 8009 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:45811
I20260811 07:03:25.884231 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab.
Entry for principal oryx/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab.
WARNING: no policy specified for oryx/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab.
Entry for principal oryx/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab.
WARNING: no policy specified for oryx/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab.
Entry for principal oryx/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab.
I20260811 07:03:26.070022 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8077
Aug 11 07:03:26 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:03:26.090273 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:26.071597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43458 (local address 127.30.73.65:33441)
0811 07:03:26.072391 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:26.072398 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:26.072427 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:03:26.072510 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:26.072516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:26.072745 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:26.072887 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:26.074890 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:26.076509 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:26.078045 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:26.078788 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:26.078905 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:26.083944 (+ 5039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:26.083959 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:26.083975 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:26.084018 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:26.087061 (+ 3043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:26.087873 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:26.087880 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:26.087882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:26.088009 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:26.088420 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:26.088424 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:26.088426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:26.088842 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:26.089191 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:26.089399 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 07:03:26.089673 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":395,"threads_started":1}
I20260811 07:03:26.091599 8222 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:26.176591 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 8077
I20260811 07:03:26.197235 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8235
Aug 11 07:03:26 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:03:26.215850 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:26.198200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55890 (local address 127.30.73.66:38629)
0811 07:03:26.198697 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:26.198706 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:26.198733 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:03:26.198796 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:26.198802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:26.199008 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:26.199135 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:26.200395 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:26.201358 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:26.203027 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:26.203765 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:26.203866 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:26.208657 (+ 4791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:26.208670 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:26.208690 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:26.208742 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:26.212142 (+ 3400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:26.212960 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:26.212967 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:26.212970 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:26.213121 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:26.213627 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:26.213632 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:26.213634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:26.214228 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:26.214650 (+ 422us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:26.215029 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 07:03:26.215408 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":250,"threads_started":1}
I20260811 07:03:26.217228 8376 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:26.305991 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 8235
I20260811 07:03:26.329041 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8388
Aug 11 07:03:26 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:03:26.346225 8551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:26.330097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50560 (local address 127.30.73.67:34777)
0811 07:03:26.330677 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:26.330685 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:26.330717 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:03:26.330791 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:26.330798 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:26.331012 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:26.331138 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:26.332392 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:26.333406 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:26.334884 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:26.335472 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:26.335584 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:26.340093 (+ 4509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:26.340107 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:26.340125 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:26.340159 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:26.343170 (+ 3011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:26.343900 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:26.343907 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:26.343909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:26.344039 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:26.344448 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:26.344453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:26.344455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:26.344814 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:26.345139 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:26.345475 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 07:03:26.345771 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":261,"threads_started":1}
I20260811 07:03:26.347471 8529 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:26.431998 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 8388
I20260811 07:03:26.454110 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 7969
I20260811 07:03:26.455691 8040 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:26.560848 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 7969
I20260811 07:03:26.586473 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:43655
--webserver_interface=127.30.73.126
--webserver_port=36007
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:43655
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:26.934417 8554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:26.934785 8554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:26.934942 8554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:26.942559 8554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:26.942729 8554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:26.942848 8554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:26.942948 8554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:26.943035 8554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:26.954052 8554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:43655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:43655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=36007
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:26.955551 8554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:26.956933 8554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:26.969441 8562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:26.969478 8563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:26.969441 8565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:26.971017 8554 server_base.cc:1034] running on GCE node
I20260811 07:03:26.972024 8554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:26.973590 8554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:26.974844 8554 hybrid_clock.cc:648] HybridClock initialized: now 1786431806974801 us; error 78 us; skew 500 ppm
I20260811 07:03:26.975246 8554 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:26 dist-test-slave-69rg krb5kdc[7954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431806, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:26.978623 8554 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:03:26.980304 8554 webserver.cc:460] Webserver started at http://127.30.73.126:36007/ using document root <none> and password file <none>
I20260811 07:03:26.981061 8554 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:26.981240 8554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:26.987200 8554 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:03:26.990829 8573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:26.992654 8554 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:03:26.992889 8554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "f309a73725c741fa818df2ec1e5dc623"
format_stamp: "Formatted at 2026-08-11 07:03:23 on dist-test-slave-69rg"
server_key: "fa8e3b810a6a2466fd676cda0cc0eb84"
server_key_iv: "3793d79c7899f9ae47d878236410b917"
server_key_version: "encryptionkey@0"
I20260811 07:03:26.994071 8554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:27.012873 8554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:27.019634 8554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:27.019951 8554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:27.046060 8554 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:43655
I20260811 07:03:27.046025 8630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:43655 every 8 connection(s)
I20260811 07:03:27.048568 8554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:03:27.056115 8631 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:03:27.056713 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 8554
I20260811 07:03:27.057933 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:33441
--local_ip_for_outbound_sockets=127.30.73.65
--tserver_master_addrs=127.30.73.126:43655
--webserver_port=43819
--webserver_interface=127.30.73.65
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.73.65
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:03:27.060505 8631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: Bootstrap starting.
I20260811 07:03:27.084384 8631 log.cc:824] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:27.103072 8631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:03:27.103857 8631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: Bootstrap complete.
I20260811 07:03:27.118273 8631 raft_consensus.cc:348] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } }
I20260811 07:03:27.119511 8631 raft_consensus.cc:729] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f309a73725c741fa818df2ec1e5dc623, State: Initialized, Role: FOLLOWER
I20260811 07:03:27.120270 8631 consensus_queue.cc:260] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } }
I20260811 07:03:27.120563 8631 raft_consensus.cc:388] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:03:27.120707 8631 raft_consensus.cc:482] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:03:27.120891 8631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:03:27.127187 8631 raft_consensus.cc:504] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } }
I20260811 07:03:27.127841 8631 leader_election.cc:302] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f309a73725c741fa818df2ec1e5dc623; no voters:
I20260811 07:03:27.128595 8631 leader_election.cc:288] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:03:27.128882 8635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:03:27.130103 8635 raft_consensus.cc:686] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [term 2 LEADER]: Becoming Leader. State: Replica: f309a73725c741fa818df2ec1e5dc623, State: Running, Role: LEADER
I20260811 07:03:27.130743 8635 consensus_queue.cc:237] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } }
I20260811 07:03:27.130975 8631 sys_catalog.cc:564] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:03:27.133445 8637 sys_catalog.cc:455] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f309a73725c741fa818df2ec1e5dc623. Latest consensus state: current_term: 2 leader_uuid: "f309a73725c741fa818df2ec1e5dc623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } } }
I20260811 07:03:27.133445 8636 sys_catalog.cc:455] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f309a73725c741fa818df2ec1e5dc623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f309a73725c741fa818df2ec1e5dc623" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43655 } } }
I20260811 07:03:27.133876 8637 sys_catalog.cc:458] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:27.133877 8636 sys_catalog.cc:458] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:27.136552 8643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:03:27.142691 8643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:03:27.144176 8643 catalog_manager.cc:1259] Loaded cluster ID: 2182c222469841a9a0d8db5568552b3b
I20260811 07:03:27.144354 8643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:03:27.148641 8643 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:03:27.150173 8643 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f309a73725c741fa818df2ec1e5dc623: Loaded TSK: 0
I20260811 07:03:27.151793 8643 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:03:27.456933 8633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:27.457235 8633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:27.457412 8633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:27.465679 8633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:27.465802 8633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:27.466050 8633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:03:27.476217 8633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.65.keytab
--principal=oryx/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:33441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=43819
--tserver_master_addrs=127.30.73.126:43655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:27.477608 8633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:27.478986 8633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:27.492326 8662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:27.492933 8664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:27.492362 8659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:27.493399 8633 server_base.cc:1034] running on GCE node
I20260811 07:03:27.494181 8633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:27.495139 8633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:27.496399 8633 hybrid_clock.cc:648] HybridClock initialized: now 1786431807496357 us; error 53 us; skew 500 ppm
I20260811 07:03:27.496739 8633 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:27 dist-test-slave-69rg krb5kdc[7954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431807, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:27.500212 8633 init.cc:377] Logged in from keytab as oryx/127.30.73.65@KRBTEST.COM (short username oryx)
I20260811 07:03:27.501667 8633 webserver.cc:460] Webserver started at http://127.30.73.65:43819/ using document root <none> and password file <none>
I20260811 07:03:27.502437 8633 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:27.502607 8633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:27.507848 8633 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 07:03:27.510538 8673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:27.511868 8633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:27.512051 8633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "3114f07867ed4108b6ee5566b442d069"
format_stamp: "Formatted at 2026-08-11 07:03:24 on dist-test-slave-69rg"
server_key: "a5bcf67344c31e44bdcb8d748462f362"
server_key_iv: "60eecdc2c9fb32a89e4105d3fd00c4de"
server_key_version: "encryptionkey@0"
I20260811 07:03:27.513056 8633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:27.550798 8633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:27.555552 8633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:27.555889 8633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:27.556936 8633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:27.558439 8633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:27.558566 8633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:27.558715 8633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:27.558811 8633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:27.594058 8633 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:33441
I20260811 07:03:27.594116 8804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:33441 every 8 connection(s)
I20260811 07:03:27.595671 8633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:03:27.605386 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 8633
I20260811 07:03:27.606204 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:38629
--local_ip_for_outbound_sockets=127.30.73.66
--tserver_master_addrs=127.30.73.126:43655
--webserver_port=38667
--webserver_interface=127.30.73.66
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.73.66
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:03:27 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:27 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:03:27.968195 8809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:27.968519 8809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:27.968684 8809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:27.975883 8809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:27.976038 8809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:27.976214 8809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:03:27.986213 8809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.66.keytab
--principal=oryx/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:38629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=38667
--tserver_master_addrs=127.30.73.126:43655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:27.987771 8809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:27.989135 8809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:28.003757 8816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:28.004026 8817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:28.004971 8819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:28.005946 8809 server_base.cc:1034] running on GCE node
I20260811 07:03:28.006692 8809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:28.007797 8809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:28.009037 8809 hybrid_clock.cc:648] HybridClock initialized: now 1786431808008981 us; error 49 us; skew 500 ppm
I20260811 07:03:28.009335 8809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:28 dist-test-slave-69rg krb5kdc[7954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431808, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:28.013230 8809 init.cc:377] Logged in from keytab as oryx/127.30.73.66@KRBTEST.COM (short username oryx)
I20260811 07:03:28.015067 8809 webserver.cc:460] Webserver started at http://127.30.73.66:38667/ using document root <none> and password file <none>
I20260811 07:03:28.015887 8809 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:28.016055 8809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:28.022562 8809 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:03:28.026010 8829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:28.027786 8809 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:03:28.027982 8809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "36d89b6a397042ac85ea666abc1b6183"
format_stamp: "Formatted at 2026-08-11 07:03:25 on dist-test-slave-69rg"
server_key: "ec6bfebe51e970d821c754daefe2a0f1"
server_key_iv: "b06f8aba03fc94e76c9dac4c7d832d96"
server_key_version: "encryptionkey@0"
I20260811 07:03:28.028998 8809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:28.060204 8809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:28.066833 8809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:28.067188 8809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:28.068717 8809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:28.070727 8809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:28.070873 8809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:28.070981 8809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:28.071055 8809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:28.121609 8809 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:38629
I20260811 07:03:28.121668 8956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:38629 every 8 connection(s)
I20260811 07:03:28.123205 8809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:03:28.130849 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 8809
I20260811 07:03:28.131968 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:34777
--local_ip_for_outbound_sockets=127.30.73.67
--tserver_master_addrs=127.30.73.126:43655
--webserver_port=33721
--webserver_interface=127.30.73.67
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.73.67
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:03:28 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:28 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:03:28.505209 8961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:28.505544 8961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:28.505728 8961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:28.513444 8961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:28.513630 8961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:28.513861 8961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:03:28.525276 8961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/krb5kdc/oryx_127.30.73.67.keytab
--principal=oryx/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:34777
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=33721
--tserver_master_addrs=127.30.73.126:43655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:28.527069 8961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:28.528406 8961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:28.547255 8968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:28.547847 8969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:28.559935 8971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:28.561672 8961 server_base.cc:1034] running on GCE node
I20260811 07:03:28.562520 8961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:28.563736 8961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:28.565016 8961 hybrid_clock.cc:648] HybridClock initialized: now 1786431808564950 us; error 64 us; skew 500 ppm
I20260811 07:03:28.565390 8961 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:28 dist-test-slave-69rg krb5kdc[7954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431808, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:28.569133 8961 init.cc:377] Logged in from keytab as oryx/127.30.73.67@KRBTEST.COM (short username oryx)
I20260811 07:03:28.571467 8961 webserver.cc:460] Webserver started at http://127.30.73.67:33721/ using document root <none> and password file <none>
I20260811 07:03:28.572280 8961 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:28.572468 8961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:28.578769 8961 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:03:28.581808 8978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:28.583427 8961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:03:28.583626 8961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "575ef8eb32204652b446075b13fdc5a5"
format_stamp: "Formatted at 2026-08-11 07:03:25 on dist-test-slave-69rg"
server_key: "5770307e6713ad9f852608ae8f37783d"
server_key_iv: "373ff61763474176cb4a8be360bb0974"
server_key_version: "encryptionkey@0"
I20260811 07:03:28.584643 8961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:28.605291 8961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:28.610597 8961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:28.610924 8961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:28.612102 8961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:28.613706 8961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:28.613965 8961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:28.614115 8961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:28.614209 8961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:28.660638 8961 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:34777
I20260811 07:03:28.660681 9103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:34777 every 8 connection(s)
I20260811 07:03:28.662415 8961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:03:28.672209 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 8961
Aug 11 07:03:28 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:28 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:28.758677 9107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:28.674333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59102 (local address 127.30.73.126:43655)
0811 07:03:28.720095 (+ 45762us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:28.720104 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:28.720132 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:03:28.720223 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:28.720231 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:28.720338 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:28.720485 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:28.730027 (+ 9542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.731905 (+ 1878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.737450 (+ 5545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.738311 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.738433 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:28.745597 (+ 7164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:28.745604 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:28.745621 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:28.745661 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:28.749882 (+ 4221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:28.751250 (+ 1368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:28.751261 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:28.751273 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:28.751492 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:28.754290 (+ 2798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:28.754298 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:28.754304 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:28.755041 (+ 737us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:28.756676 (+ 1635us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:28.756980 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 07:03:28.757510 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45577,"thread_start_us":43327,"threads_started":1}
W20260811 07:03:29.311228 8807 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.700s user 0.003s sys 0.015s
W20260811 07:03:29.313516 8808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:27.600225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:58477 (local address 127.30.73.126:43655)
0811 07:03:27.600864 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:27.600874 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:27.600910 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:03:27.602699 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:27.602712 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:27.603077 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:27.603387 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:27.604907 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:27.606881 (+ 1974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:27.608679 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:27.609771 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:27.610002 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.313025 (+1703023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:58477: BlockingRecv error: recv got EOF from 127.30.73.65:58477 (error 108)
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":284,"threads_started":1}
I20260811 07:03:29.316620 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:27.599258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:58477)
0811 07:03:27.600209 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:27.600260 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:27.602168 (+ 1908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:27.603533 (+ 1365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:27.603540 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:27.604079 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:27.604624 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:27.604642 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:27.607077 (+ 2435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:27.607081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:27.608510 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:27.608525 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:27.610063 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:27.610068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:27.610280 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:27.611045 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:27.611116 (+ 71us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:29.314750 (+1703634us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":395,"threads_started":1}
W20260811 07:03:29.319027 8805 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:43655 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.73.126:43655: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:03:29.356858 8808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:29.323924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:44165 (local address 127.30.73.126:43655)
0811 07:03:29.324194 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:29.324205 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:29.325736 (+ 1531us) server_negotiation.cc:407] Connection header received
0811 07:03:29.327124 (+ 1388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:29.327134 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:29.327252 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:29.327353 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:29.330459 (+ 3106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.332391 (+ 1932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.339332 (+ 6941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.340397 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.340545 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.356337 (+ 15792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:44165: BlockingRecv error: recv got EOF from 127.30.73.65:44165 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:03:29.358106 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:29.323392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:44165)
0811 07:03:29.325599 (+ 2207us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:29.325630 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:29.326697 (+ 1067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:29.327734 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:29.327742 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:29.328499 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:29.328823 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.328840 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.332764 (+ 3924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.332774 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.339033 (+ 6259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.339076 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.340994 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.341005 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.341326 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.349278 (+ 7952us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:29.349319 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:29.357547 (+ 8228us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2018,"thread_start_us":12562,"threads_started":1}
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:03:29.384361 8808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:29.360506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:32875 (local address 127.30.73.126:43655)
0811 07:03:29.361228 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:29.361238 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:29.361263 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:03:29.361338 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:29.361345 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:29.361454 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:29.361595 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:29.365470 (+ 3875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.367446 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.371144 (+ 3698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.372203 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.372385 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.383912 (+ 11527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:32875: BlockingRecv error: recv got EOF from 127.30.73.65:32875 (error 108)
Metrics: {"server-negotiator.queue_time_us":551}
I20260811 07:03:29.385555 9111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:29.359426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:32875)
0811 07:03:29.359651 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:29.359675 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:29.359807 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:29.361932 (+ 2125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:29.361941 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:29.362863 (+ 922us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:29.363344 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.363364 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.367735 (+ 4371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.367745 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.370845 (+ 3100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.370875 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.372768 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.372780 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.373110 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.374225 (+ 1115us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:29.374263 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:29.385078 (+ 10815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 07:03:29.386327 8805 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:03:29.677533 8960 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.540s user 0.004s sys 0.012s
W20260811 07:03:29.679685 8959 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:28.126346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:57989 (local address 127.30.73.126:43655)
0811 07:03:28.126841 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:28.126846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:28.128567 (+ 1721us) server_negotiation.cc:407] Connection header received
0811 07:03:28.130631 (+ 2064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:28.130636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:28.130738 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:28.130866 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:28.132773 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.133703 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.135411 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.135833 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.135984 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.679163 (+1543179us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:57989: BlockingRecv error: recv got EOF from 127.30.73.66:57989 (error 108)
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":258,"threads_started":1}
I20260811 07:03:29.680143 8960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:28.127421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:57989)
0811 07:03:28.128366 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:28.128404 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:28.130360 (+ 1956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:28.131278 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:28.131296 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:28.131822 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:28.132578 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:28.132597 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.133902 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.133909 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:28.135258 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:28.135278 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.136086 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.136097 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:28.136417 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:28.137310 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:28.137347 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:29.678724 (+1541377us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":412,"threads_started":1}
W20260811 07:03:29.682199 8957 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:43655 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.73.126:43655: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:29.697201 8960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:29.683224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:48279)
0811 07:03:29.683678 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:29.683701 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:29.683826 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:29.684495 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:29.684503 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:29.685122 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:29.685394 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.685410 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.687063 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.687073 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.689810 (+ 2737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.689877 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.690707 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.690717 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.691016 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.691949 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:29.691987 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:29.696867 (+ 4880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":297}
W20260811 07:03:29.697365 8959 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:29.683804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:48279 (local address 127.30.73.126:43655)
0811 07:03:29.684039 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:29.684049 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:29.684076 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:03:29.684148 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:29.684156 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:29.684268 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:29.684411 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:29.685585 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.686870 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.690051 (+ 3181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.690472 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.690581 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.697097 (+ 6516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:48279: BlockingRecv error: recv got EOF from 127.30.73.66:48279 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:29.711027 8960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:29.698432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:53691)
0811 07:03:29.698694 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:29.698715 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:29.698842 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:29.699276 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:29.699284 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:29.700188 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:29.700503 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.700521 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.701615 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.701623 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.704019 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.704041 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.704974 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.704984 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.705276 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.706134 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:29.706155 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:29.710719 (+ 4564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146}
W20260811 07:03:29.711469 8957 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:03:29.711577 8959 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:29.698608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:53691 (local address 127.30.73.126:43655)
0811 07:03:29.698838 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:29.698845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:29.698862 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:03:29.698952 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:29.698957 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:29.699060 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:29.699162 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:29.700688 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.701445 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.704240 (+ 2795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.704766 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.704870 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.710931 (+ 6061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:53691: BlockingRecv error: recv got EOF from 127.30.73.66:53691 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
W20260811 07:03:29.962064 9106 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.215s user 0.001s sys 0.016s
W20260811 07:03:29.963390 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:28.667364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:44599 (local address 127.30.73.126:43655)
0811 07:03:28.716483 (+ 49119us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:28.716494 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:28.729871 (+ 13377us) server_negotiation.cc:407] Connection header received
0811 07:03:28.737725 (+ 7854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:28.737736 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:28.737895 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:28.737976 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:28.740127 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.741378 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.744261 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.744975 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.745083 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.963157 (+1218074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:44599: BlockingRecv error: recv got EOF from 127.30.73.67:44599 (error 108)
Metrics: {"server-negotiator.queue_time_us":48893,"thread_start_us":54748,"threads_started":1}
I20260811 07:03:29.963820 9106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:28.666567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:44599)
0811 07:03:28.725865 (+ 59298us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:28.725946 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:28.729724 (+ 3778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:28.738690 (+ 8966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:28.738700 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:28.739338 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:28.739943 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:28.739962 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.741587 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.741595 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:28.744063 (+ 2468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:28.744084 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:28.745998 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:28.746009 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:28.746344 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:28.747426 (+ 1082us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:28.747455 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:29.962841 (+1215386us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58752,"thread_start_us":66245,"threads_started":1}
W20260811 07:03:29.964869 9104 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:43655 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.73.126:43655: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:29.975344 9106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:29.965631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:38083)
0811 07:03:29.965893 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:29.965910 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:29.966065 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:29.966499 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:29.966504 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:29.967022 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:29.967232 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.967241 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.968385 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.968389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.969428 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.969441 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.970420 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.970425 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.970555 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.971234 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:29.971255 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:29.975123 (+ 3868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96}
W20260811 07:03:29.975687 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:29.965723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:38083 (local address 127.30.73.126:43655)
0811 07:03:29.965933 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:29.965941 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:29.965983 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:03:29.966222 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:29.966248 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:29.966338 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:29.966442 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:29.967401 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.968216 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.969594 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.970229 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.970358 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.975383 (+ 5025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:38083: BlockingRecv error: recv got EOF from 127.30.73.67:38083 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:29 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:29.989589 9106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:29.976156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:54697)
0811 07:03:29.976366 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:29.976389 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:29.976513 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:29.976863 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:29.976867 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:29.977220 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:29.977381 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.977389 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.978951 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.978964 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.980333 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:29.980349 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.981207 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.981213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:29.981412 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.982609 (+ 1197us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:29.982630 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:29.989172 (+ 6542us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99}
W20260811 07:03:29.989964 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:29.976176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:54697 (local address 127.30.73.126:43655)
0811 07:03:29.976568 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:29.976572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:29.976588 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:03:29.976640 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:29.976643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:29.976699 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:29.976784 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:29.977607 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.978794 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.980518 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:29.981008 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:29.981158 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:29.989520 (+ 8362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:54697: BlockingRecv error: recv got EOF from 127.30.73.67:54697 (error 108)
Metrics: {"server-negotiator.queue_time_us":255}
W20260811 07:03:29.990046 9104 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 07:03:30 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:30 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:30.403254 9112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:30.388228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:55117)
0811 07:03:30.389128 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:30.389150 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:30.390111 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:30.391834 (+ 1723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:30.391842 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:30.392333 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:30.392518 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:30.392529 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.393662 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.393668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:30.394648 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:30.394660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.396194 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.396202 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:30.396441 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:30.397417 (+ 976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:30.397441 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:30.402831 (+ 5390us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":360,"threads_started":1}
W20260811 07:03:30.403801 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:30.388204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:55117 (local address 127.30.73.126:43655)
0811 07:03:30.388552 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:30.388560 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:30.390020 (+ 1460us) server_negotiation.cc:407] Connection header received
0811 07:03:30.391257 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:30.391264 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:30.391366 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:30.391505 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:30.392719 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.393488 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.394965 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.395883 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.396140 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:30.403150 (+ 7010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:55117: BlockingRecv error: recv got EOF from 127.30.73.65:55117 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Aug 11 07:03:30 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:30 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:30.723431 9113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:30.712304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:55533)
0811 07:03:30.712972 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:30.712990 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:30.713144 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:30.713495 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:30.713498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:30.714075 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:30.714257 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:30.714266 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.715391 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.715396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:30.716427 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:30.716439 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.717440 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.717446 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:30.717672 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:30.718603 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:30.718624 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:30.722985 (+ 4361us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":372,"threads_started":1}
W20260811 07:03:30.723569 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:30.712477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:55533 (local address 127.30.73.126:43655)
0811 07:03:30.712709 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:30.712715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:30.713093 (+ 378us) server_negotiation.cc:407] Connection header received
0811 07:03:30.713263 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:30.713268 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:30.713342 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:30.713445 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:30.714387 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.715240 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.716577 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.717197 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.717297 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:30.723270 (+ 5973us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:55533: BlockingRecv error: recv got EOF from 127.30.73.66:55533 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 07:03:30 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:30 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:31.003742 9114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:30.990906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:50673)
0811 07:03:30.991667 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:30.991687 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:30.991845 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:30.992630 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:30.992635 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:30.993197 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:30.993405 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:30.993417 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.995191 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.995196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:30.996473 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:30.996490 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.997269 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.997274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:30.997413 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:30.998285 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:30.998305 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:31.003391 (+ 5086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":449,"threads_started":1}
W20260811 07:03:31.004360 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:30.991023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:50673 (local address 127.30.73.126:43655)
0811 07:03:30.991245 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:30.991251 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:30.991819 (+ 568us) server_negotiation.cc:407] Connection header received
0811 07:03:30.992044 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:30.992049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:30.992383 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:30.992507 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:30.993645 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.994997 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.996623 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:30.997077 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:30.997178 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:31.003944 (+ 6766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:50673: BlockingRecv error: recv got EOF from 127.30.73.67:50673 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 07:03:31 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:31 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:31.415784 9115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:31.404690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:34427)
0811 07:03:31.405314 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:31.405335 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:31.405526 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:31.405911 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:31.405915 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:31.406394 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:31.406575 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:31.406585 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:31.407774 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:31.407779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:31.408990 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:31.409026 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:31.409848 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:31.409857 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:31.410074 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:31.410744 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:31.410764 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:31.415340 (+ 4576us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":352,"threads_started":1}
W20260811 07:03:31.415987 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:31.404745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:34427 (local address 127.30.73.126:43655)
0811 07:03:31.405022 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:31.405032 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:31.405487 (+ 455us) server_negotiation.cc:407] Connection header received
0811 07:03:31.405654 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:31.405658 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:31.405741 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:31.405870 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:31.406742 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:31.407615 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:31.409179 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:31.409628 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:31.409799 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:31.415624 (+ 5825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:34427: BlockingRecv error: recv got EOF from 127.30.73.65:34427 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 07:03:31 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:31 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:31.735805 9116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:31.724788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:59985)
0811 07:03:31.725465 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:31.725483 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:31.725634 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:31.726032 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:31.726036 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:31.726570 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:31.726785 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:31.726795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:31.727941 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:31.727946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:31.729019 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:31.729036 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:31.729932 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:31.729939 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:31.730157 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:31.730919 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:31.730943 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:31.735365 (+ 4422us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":382,"threads_started":1}
W20260811 07:03:31.735829 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:31.724876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:59985 (local address 127.30.73.126:43655)
0811 07:03:31.725122 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:31.725127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:31.725581 (+ 454us) server_negotiation.cc:407] Connection header received
0811 07:03:31.725755 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:31.725759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:31.725861 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:31.725973 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:31.726931 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:31.727758 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:31.729183 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:31.729707 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:31.729890 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:31.735597 (+ 5707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:59985: BlockingRecv error: recv got EOF from 127.30.73.66:59985 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 11 07:03:32 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:32 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:32.017326 9117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:32.005308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:51165)
0811 07:03:32.006046 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:32.006087 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:32.006257 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:32.006746 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:32.006752 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:32.007421 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:32.007661 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:32.007673 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.009027 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.009035 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:32.010138 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:32.010153 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.011060 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.011067 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:32.011268 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:32.012069 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:32.012091 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:32.016851 (+ 4760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":381,"threads_started":1}
W20260811 07:03:32.017516 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:32.005636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:51165 (local address 127.30.73.126:43655)
0811 07:03:32.005951 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:32.005958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:32.006197 (+ 239us) server_negotiation.cc:407] Connection header received
0811 07:03:32.006409 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:32.006415 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:32.006512 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:32.006700 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:32.007817 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.008834 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.010313 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.010836 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.010985 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:32.017190 (+ 6205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:51165: BlockingRecv error: recv got EOF from 127.30.73.67:51165 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Aug 11 07:03:32 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:32 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:32.428869 9118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:32.417211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:60605)
0811 07:03:32.417909 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:32.417928 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:32.418136 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:32.418668 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:32.418675 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:32.419259 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:32.419489 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:32.419500 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.420700 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.420706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:32.421799 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:32.421848 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.422792 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.422799 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:32.423045 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:32.423921 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:32.423941 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:32.428382 (+ 4441us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":407,"threads_started":1}
W20260811 07:03:32.428987 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:32.417248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:60605 (local address 127.30.73.126:43655)
0811 07:03:32.417547 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:32.417554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:32.418028 (+ 474us) server_negotiation.cc:407] Connection header received
0811 07:03:32.418378 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:32.418388 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:32.418497 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:32.418627 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:32.419665 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.420519 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.422005 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.422604 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.422769 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:32.428646 (+ 5877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:60605: BlockingRecv error: recv got EOF from 127.30.73.65:60605 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 11 07:03:32 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:32 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:32.749215 9119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:32.737148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:46805)
0811 07:03:32.737972 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:32.737993 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:32.738251 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:32.738894 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:32.738903 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:32.739538 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:32.740001 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:32.740018 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.741498 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.741503 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:32.742571 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:32.742587 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.743423 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.743429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:32.743619 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:32.744481 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:32.744503 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:32.748910 (+ 4407us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":447,"threads_started":1}
W20260811 07:03:32.749576 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:32.737348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:46805 (local address 127.30.73.126:43655)
0811 07:03:32.737584 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:32.737590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:32.738153 (+ 563us) server_negotiation.cc:407] Connection header received
0811 07:03:32.738462 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:32.738466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:32.738587 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:32.738743 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:32.740243 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.741323 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.742734 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:32.743219 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:32.743326 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:32.749194 (+ 5868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:46805: BlockingRecv error: recv got EOF from 127.30.73.66:46805 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 07:03:33 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:33 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:33.030646 9120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:33.018814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:50985)
0811 07:03:33.019510 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:33.019528 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:33.019691 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:33.020153 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:33.020157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:33.020604 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:33.020810 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:33.020820 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.022150 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.022155 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:33.023225 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:33.023249 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.024245 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.024251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:33.024486 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:33.025409 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:33.025435 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:33.030167 (+ 4732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":399,"threads_started":1}
W20260811 07:03:33.030750 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:33.018937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:50985 (local address 127.30.73.126:43655)
0811 07:03:33.019148 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:33.019153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:33.019694 (+ 541us) server_negotiation.cc:407] Connection header received
0811 07:03:33.019816 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:33.019821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:33.019918 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:33.020155 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:33.020991 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.021938 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.023430 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.024073 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.024227 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:33.030474 (+ 6247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:50985: BlockingRecv error: recv got EOF from 127.30.73.67:50985 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 07:03:33 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:33 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:33.442998 9121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:33.430525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:43183)
0811 07:03:33.431138 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:33.431157 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:33.431333 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:33.431979 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:33.431983 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:33.432616 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:33.432856 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:33.432867 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.434345 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.434351 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:33.436176 (+ 1825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:33.436191 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.437036 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.437041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:33.437263 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:33.438216 (+ 953us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:33.438272 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:33.442544 (+ 4272us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":326,"threads_started":1}
W20260811 07:03:33.443147 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:33.430765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:43183 (local address 127.30.73.126:43655)
0811 07:03:33.431083 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:33.431093 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:33.431276 (+ 183us) server_negotiation.cc:407] Connection header received
0811 07:03:33.431671 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:33.431676 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:33.431762 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:33.431874 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:33.433034 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.434181 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.436345 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.436870 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.436999 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:33.442826 (+ 5827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:43183: BlockingRecv error: recv got EOF from 127.30.73.65:43183 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 11 07:03:33 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:33 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:33.765745 9122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:33.750652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:58325)
0811 07:03:33.751313 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:33.751360 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:33.751581 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:33.752062 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:33.752068 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:33.752785 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:33.753118 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:33.753136 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.756563 (+ 3427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.756569 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:33.758326 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:33.758347 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.759312 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.759318 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:33.759500 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:33.760460 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:33.760497 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:33.765262 (+ 4765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":348,"threads_started":1}
W20260811 07:03:33.765794 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:33.750743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:58325 (local address 127.30.73.126:43655)
0811 07:03:33.751018 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:33.751026 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:33.751483 (+ 457us) server_negotiation.cc:407] Connection header received
0811 07:03:33.751744 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:33.751748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:33.751858 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:33.751999 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:33.753330 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.756303 (+ 2973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.758567 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:33.759118 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:33.759246 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:33.765542 (+ 6296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:58325: BlockingRecv error: recv got EOF from 127.30.73.66:58325 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 11 07:03:34 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:34 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:34.044018 9123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:34.032191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:35717)
0811 07:03:34.032918 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:34.032939 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:34.033096 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:34.033598 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:34.033602 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:34.034161 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:34.034430 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:34.034444 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.035677 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.035681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:34.036988 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:34.037006 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.037960 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.037969 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:34.038165 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:34.039025 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:34.039049 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:34.043546 (+ 4497us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":414,"threads_started":1}
W20260811 07:03:34.044094 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:34.032209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:35717 (local address 127.30.73.126:43655)
0811 07:03:34.032531 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:34.032540 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:34.033049 (+ 509us) server_negotiation.cc:407] Connection header received
0811 07:03:34.033258 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:34.033262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:34.033384 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:34.033554 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:34.034667 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.035504 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.037181 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.037730 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.037985 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:34.043761 (+ 5776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:35717: BlockingRecv error: recv got EOF from 127.30.73.67:35717 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 07:03:34 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:34 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:34.459656 9124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:34.444265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:34797)
0811 07:03:34.444917 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:34.444941 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:34.445149 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:34.445529 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:34.445534 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:34.446095 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:34.446271 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:34.446280 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.447435 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.447439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:34.448459 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:34.448471 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.449241 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.449246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:34.449452 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:34.454879 (+ 5427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:34.454904 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:34.459223 (+ 4319us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":361,"threads_started":1}
W20260811 07:03:34.459821 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:34.444378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:34797 (local address 127.30.73.126:43655)
0811 07:03:34.444746 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:34.444754 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:34.445055 (+ 301us) server_negotiation.cc:407] Connection header received
0811 07:03:34.445297 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:34.445302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:34.445381 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:34.445496 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:34.446427 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.447254 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.448626 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.449067 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.449212 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:34.459525 (+ 10313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:34797: BlockingRecv error: recv got EOF from 127.30.73.65:34797 (error 108)
Metrics: {"server-negotiator.queue_time_us":161}
Aug 11 07:03:34 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:34 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:34.778234 9125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:34.767062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:35879)
0811 07:03:34.767753 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:34.767772 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:34.767930 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:34.768349 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:34.768353 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:34.768925 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:34.769125 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:34.769136 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.770376 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.770387 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:34.771624 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:34.771639 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.772633 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.772641 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:34.772843 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:34.773591 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:34.773611 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:34.777911 (+ 4300us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":357,"threads_started":1}
W20260811 07:03:34.778472 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:34.767413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:35879 (local address 127.30.73.126:43655)
0811 07:03:34.767653 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:34.767658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:34.767858 (+ 200us) server_negotiation.cc:407] Connection header received
0811 07:03:34.768055 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:34.768059 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:34.768132 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:34.768225 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:34.769270 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.770211 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.771786 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:34.772465 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:34.772611 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:34.778178 (+ 5567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:35879: BlockingRecv error: recv got EOF from 127.30.73.66:35879 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 11 07:03:35 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:35 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:35.058168 9127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:35.045442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:36965)
0811 07:03:35.046143 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:35.046163 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:35.046385 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:35.046869 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:35.046874 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:35.047823 (+ 949us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:35.048063 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:35.048076 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.049345 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.049350 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:35.050983 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:35.051000 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.051830 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.051837 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:35.052068 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:35.052935 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:35.052958 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:35.057802 (+ 4844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":427,"threads_started":1}
W20260811 07:03:35.058393 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:35.045496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:36965 (local address 127.30.73.126:43655)
0811 07:03:35.045788 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:35.045801 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:35.046297 (+ 496us) server_negotiation.cc:407] Connection header received
0811 07:03:35.046613 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:35.046618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:35.046695 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:35.046792 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:35.048236 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.049196 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.051134 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.051648 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.051807 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:35.058152 (+ 6345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:36965: BlockingRecv error: recv got EOF from 127.30.73.67:36965 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 11 07:03:35 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:35 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:35.472918 9128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:35.461018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:56515)
0811 07:03:35.461702 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:35.461722 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:35.462004 (+ 282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:35.462448 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:35.462453 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:35.463133 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:35.463334 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:35.463345 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.464920 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.464926 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:35.466041 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:35.466058 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.466924 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.466929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:35.467100 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:35.467934 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:35.467956 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:35.472525 (+ 4569us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":356,"threads_started":1}
W20260811 07:03:35.473134 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:35.461109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:56515 (local address 127.30.73.126:43655)
0811 07:03:35.461343 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:35.461349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:35.461920 (+ 571us) server_negotiation.cc:407] Connection header received
0811 07:03:35.462166 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:35.462170 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:35.462246 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:35.462333 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:35.463486 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.464592 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.466250 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.466710 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.466820 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:35.472777 (+ 5957us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:56515: BlockingRecv error: recv got EOF from 127.30.73.65:56515 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 07:03:35 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:35 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:35.790045 9129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:35.779584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:45273)
0811 07:03:35.780274 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:35.780295 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:35.780481 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:35.780959 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:35.780964 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:35.781457 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:35.781689 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:35.781699 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.782976 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.782981 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:35.784070 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:35.784083 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.784855 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.784860 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:35.784993 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:35.785719 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:35.785738 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:35.789674 (+ 3936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":381,"threads_started":1}
W20260811 07:03:35.790167 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:35.779647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:45273 (local address 127.30.73.126:43655)
0811 07:03:35.779874 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:35.779882 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:35.780419 (+ 537us) server_negotiation.cc:407] Connection header received
0811 07:03:35.780626 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:35.780632 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:35.780722 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:35.780866 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:35.781878 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.782762 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.784238 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:35.784680 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:35.784777 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:35.789957 (+ 5180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:45273: BlockingRecv error: recv got EOF from 127.30.73.66:45273 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 07:03:36 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:36 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:36.072037 9130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:36.059481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:38037)
0811 07:03:36.060194 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:36.060212 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:36.060352 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:36.060839 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:36.060844 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:36.061606 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:36.061905 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:36.061921 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.063711 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.063718 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:36.065407 (+ 1689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:36.065427 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.066497 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.066503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:36.066747 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:36.067507 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:36.067533 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:36.071778 (+ 4245us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":392,"threads_started":1}
W20260811 07:03:36.072350 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:36.059543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:38037 (local address 127.30.73.126:43655)
0811 07:03:36.059808 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:36.059815 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:36.060313 (+ 498us) server_negotiation.cc:407] Connection header received
0811 07:03:36.060488 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:36.060495 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:36.060594 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:36.060721 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:36.062082 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.063468 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.065561 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.066273 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.066408 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:36.072013 (+ 5605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:38037: BlockingRecv error: recv got EOF from 127.30.73.67:38037 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 07:03:36 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:36 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:36.483974 9131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:36.474279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:36701)
0811 07:03:36.474974 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:36.474991 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:36.475165 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:36.475563 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:36.475568 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:36.476054 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:36.476246 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:36.476254 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.477367 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.477373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:36.478380 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:36.478392 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.479222 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.479228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:36.479418 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:36.480098 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:36.480117 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:36.483717 (+ 3600us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":318,"threads_started":1}
W20260811 07:03:36.484333 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:36.474413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:36701 (local address 127.30.73.126:43655)
0811 07:03:36.474714 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:36.474723 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:36.475136 (+ 413us) server_negotiation.cc:407] Connection header received
0811 07:03:36.475319 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:36.475325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:36.475415 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:36.475528 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:36.476412 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.477217 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.478527 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.479016 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.479182 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:36.483954 (+ 4772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:36701: BlockingRecv error: recv got EOF from 127.30.73.65:36701 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 07:03:36 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:36 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:36.803016 9132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:36.791328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:60181)
0811 07:03:36.792085 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:36.792105 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:36.792283 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:36.792743 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:36.792747 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:36.793264 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:36.793506 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:36.793516 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.794851 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.794855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:36.796099 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:36.796129 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.797160 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.797166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:36.797367 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:36.798290 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:36.798321 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:36.802685 (+ 4364us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":316,"threads_started":1}
W20260811 07:03:36.803231 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:36.791414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:60181 (local address 127.30.73.126:43655)
0811 07:03:36.791669 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:36.791681 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:36.792205 (+ 524us) server_negotiation.cc:407] Connection header received
0811 07:03:36.792475 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:36.792480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:36.792565 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:36.792671 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:36.793691 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.794680 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.796284 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:36.796958 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:36.797072 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:36.802956 (+ 5884us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:60181: BlockingRecv error: recv got EOF from 127.30.73.66:60181 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 11 07:03:37 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:37 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:37.087076 9134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:37.073470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:34481)
0811 07:03:37.074269 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:37.074295 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:37.074509 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:37.074943 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:37.074948 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:37.075608 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:37.075998 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:37.076031 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.078104 (+ 2073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.078110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:37.079233 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:37.079249 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.080141 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.080148 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:37.080357 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:37.081296 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:37.081319 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:37.086573 (+ 5254us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":357,"threads_started":1}
W20260811 07:03:37.087283 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:37.073527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:34481 (local address 127.30.73.126:43655)
0811 07:03:37.073798 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:37.073808 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:37.074402 (+ 594us) server_negotiation.cc:407] Connection header received
0811 07:03:37.074671 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:37.074679 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:37.074781 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:37.074893 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:37.076365 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.077720 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.079405 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.079941 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.080101 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:37.086936 (+ 6835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:34481: BlockingRecv error: recv got EOF from 127.30.73.67:34481 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 11 07:03:37 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:37 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:37.498971 9135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:37.485405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:33231)
0811 07:03:37.486194 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:37.486213 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:37.486406 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:37.487075 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:37.487080 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:37.487761 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:37.488035 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:37.488046 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.489888 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.489894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:37.490955 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:37.490969 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.492049 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.492055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:37.492226 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:37.493012 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:37.493035 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:37.498368 (+ 5333us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":440,"threads_started":1}
W20260811 07:03:37.499069 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:37.485720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:33231 (local address 127.30.73.126:43655)
0811 07:03:37.486022 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:37.486028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:37.486329 (+ 301us) server_negotiation.cc:407] Connection header received
0811 07:03:37.486684 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:37.486695 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:37.486814 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:37.486986 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:37.488278 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.489613 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.491145 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.491772 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.491948 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:37.498755 (+ 6807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:33231: BlockingRecv error: recv got EOF from 127.30.73.65:33231 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 07:03:37 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:37 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:37.816331 9136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:37.804272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:40519)
0811 07:03:37.805000 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:37.805022 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:37.805226 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:37.805698 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:37.805703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:37.806252 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:37.806446 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:37.806456 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.807736 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.807741 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:37.808743 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:37.808758 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.809575 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.809580 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:37.809739 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:37.810465 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:37.810484 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:37.815867 (+ 5383us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":389,"threads_started":1}
W20260811 07:03:37.816519 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:37.804372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:40519 (local address 127.30.73.126:43655)
0811 07:03:37.804602 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:37.804609 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:37.805145 (+ 536us) server_negotiation.cc:407] Connection header received
0811 07:03:37.805367 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:37.805372 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:37.805501 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:37.805629 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:37.806611 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.807560 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.808922 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:37.809382 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:37.809490 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:37.816189 (+ 6699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:40519: BlockingRecv error: recv got EOF from 127.30.73.66:40519 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 07:03:38 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:38 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:38.099236 9137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:38.088655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:38313)
0811 07:03:38.089389 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:38.089407 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:38.089554 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:38.090002 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:38.090005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:38.090639 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:38.090953 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:38.090977 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.092187 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.092194 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:38.093164 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:38.093177 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.093980 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.093989 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:38.094156 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:38.094853 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:38.094873 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:38.098845 (+ 3972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":366,"threads_started":1}
W20260811 07:03:38.099354 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:38.088733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:38313 (local address 127.30.73.126:43655)
0811 07:03:38.088958 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:38.088963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:38.089532 (+ 569us) server_negotiation.cc:407] Connection header received
0811 07:03:38.089698 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:38.089705 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:38.089774 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:38.089892 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:38.091141 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.092012 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.093319 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.093749 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.093916 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:38.099074 (+ 5158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:38313: BlockingRecv error: recv got EOF from 127.30.73.67:38313 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 11 07:03:38 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:38 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:38.510421 9138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:38.500208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:43101)
0811 07:03:38.500862 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:38.500879 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:38.501077 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:38.501488 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:38.501493 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:38.502029 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:38.502191 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:38.502200 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.503376 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.503382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:38.504460 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:38.504473 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.505360 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.505366 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:38.505552 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:38.506247 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:38.506266 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:38.510060 (+ 3794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":330,"threads_started":1}
W20260811 07:03:38.510525 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:38.500336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:43101 (local address 127.30.73.126:43655)
0811 07:03:38.500628 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:38.500636 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:38.501017 (+ 381us) server_negotiation.cc:407] Connection header received
0811 07:03:38.501235 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:38.501240 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:38.501319 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:38.501432 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:38.502348 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.503228 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.504614 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.505195 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.505341 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:38.510273 (+ 4932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:43101: BlockingRecv error: recv got EOF from 127.30.73.65:43101 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 11 07:03:38 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:38 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:38.828619 9139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:38.817919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:47515)
0811 07:03:38.818556 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:38.818575 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:38.818732 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:38.819091 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:38.819094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:38.819616 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:38.819800 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:38.819811 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.820913 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.820917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:38.822011 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:38.822024 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.822826 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.822831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:38.823042 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:38.823844 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:38.823874 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:38.828335 (+ 4461us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":322,"threads_started":1}
W20260811 07:03:38.828866 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:38.817979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:47515 (local address 127.30.73.126:43655)
0811 07:03:38.818268 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:38.818279 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:38.818675 (+ 396us) server_negotiation.cc:407] Connection header received
0811 07:03:38.818853 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:38.818857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:38.818930 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:38.819039 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:38.819935 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.820784 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.822156 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:38.822636 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:38.822787 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:38.828596 (+ 5809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:47515: BlockingRecv error: recv got EOF from 127.30.73.66:47515 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 07:03:39 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:39 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:39.112522 9140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:39.100733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:44119)
0811 07:03:39.101584 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:39.101602 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:39.101797 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:39.102290 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:39.102294 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:39.102846 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:39.103032 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:39.103041 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.104210 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.104217 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:39.105292 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:39.105306 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.106310 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.106316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:39.106533 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:39.107330 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:39.107352 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:39.112080 (+ 4728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":510,"threads_started":1}
W20260811 07:03:39.112733 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:39.100766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:44119 (local address 127.30.73.126:43655)
0811 07:03:39.101041 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:39.101052 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:39.101704 (+ 652us) server_negotiation.cc:407] Connection header received
0811 07:03:39.101998 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:39.102004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:39.102089 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:39.102205 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:39.103206 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.104037 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.105478 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.106100 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.106255 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:39.112393 (+ 6138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:44119: BlockingRecv error: recv got EOF from 127.30.73.67:44119 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 11 07:03:39 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:39 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:39.528939 9141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:39.511650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:49187)
0811 07:03:39.512472 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:39.512497 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:39.512684 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:39.513178 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:39.513182 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:39.513799 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:39.514089 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:39.514100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.515429 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.515434 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:39.516726 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:39.516740 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.517686 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.517691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:39.517855 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:39.523317 (+ 5462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:39.523347 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:39.528580 (+ 5233us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":492,"threads_started":1}
W20260811 07:03:39.529181 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:39.511714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:49187 (local address 127.30.73.126:43655)
0811 07:03:39.511939 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:39.511945 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:39.512635 (+ 690us) server_negotiation.cc:407] Connection header received
0811 07:03:39.512835 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:39.512841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:39.512981 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:39.513124 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:39.514264 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.515214 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.516903 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.517541 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.517650 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:39.528840 (+ 11190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:49187: BlockingRecv error: recv got EOF from 127.30.73.65:49187 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 07:03:39 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:39 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:39.840669 9143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:39.830052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:35027)
0811 07:03:39.830858 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:39.830875 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:39.831021 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:39.831347 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:39.831351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:39.831913 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:39.832100 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:39.832109 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.833278 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.833282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:39.834584 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:39.834599 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.835324 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.835329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:39.835447 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:39.836140 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:39.836159 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:39.840254 (+ 4095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":508,"threads_started":1}
W20260811 07:03:39.840886 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:39.830102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:35027 (local address 127.30.73.126:43655)
0811 07:03:39.830368 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:39.830379 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:39.830974 (+ 595us) server_negotiation.cc:407] Connection header received
0811 07:03:39.831133 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:39.831137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:39.831211 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:39.831299 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:39.832236 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.833139 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.834732 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:39.835171 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:39.835271 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:39.840516 (+ 5245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:35027: BlockingRecv error: recv got EOF from 127.30.73.66:35027 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 11 07:03:40 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:40 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:40.126768 9144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:40.114032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:52055)
0811 07:03:40.114823 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:40.114843 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:40.115067 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:40.115487 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:40.115492 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:40.116083 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:40.116325 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:40.116336 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.117736 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.117744 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:40.119092 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:40.119106 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.120028 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.120034 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:40.120253 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:40.121051 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:40.121073 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:40.126324 (+ 5251us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":463,"threads_started":1}
W20260811 07:03:40.126911 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:40.114238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:52055 (local address 127.30.73.126:43655)
0811 07:03:40.114546 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:40.114556 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:40.114967 (+ 411us) server_negotiation.cc:407] Connection header received
0811 07:03:40.115234 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:40.115238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:40.115327 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:40.115449 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:40.116500 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.117575 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.119264 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.119791 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.119994 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:40.126614 (+ 6620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:52055: BlockingRecv error: recv got EOF from 127.30.73.67:52055 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 11 07:03:40 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:40 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:40.542523 9145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:40.530250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:54195)
0811 07:03:40.530979 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:40.530999 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:40.531146 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:40.531605 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:40.531609 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:40.532162 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:40.532461 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:40.532474 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.533794 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.533799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:40.535182 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:40.535196 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.536033 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.536039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:40.536182 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:40.536976 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:40.536998 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:40.542061 (+ 5063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":388,"threads_started":1}
W20260811 07:03:40.542692 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:40.530334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:54195 (local address 127.30.73.126:43655)
0811 07:03:40.530545 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:40.530551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:40.531111 (+ 560us) server_negotiation.cc:407] Connection header received
0811 07:03:40.531265 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:40.531269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:40.531375 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:40.531473 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:40.532636 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.533595 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.535342 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.535850 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.535969 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:40.542357 (+ 6388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:54195: BlockingRecv error: recv got EOF from 127.30.73.65:54195 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 07:03:40 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:40 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:40.853972 9146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:40.842207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:50011)
0811 07:03:40.842953 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:40.842980 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:40.843195 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:40.843935 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:40.843944 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:40.844561 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:40.844792 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:40.844802 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.846031 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.846036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:40.847106 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:40.847119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.847922 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.847928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:40.848081 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:40.848820 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:40.848841 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:40.853575 (+ 4734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":372,"threads_started":1}
W20260811 07:03:40.854189 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:40.842270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:50011 (local address 127.30.73.126:43655)
0811 07:03:40.842599 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:40.842611 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:40.843097 (+ 486us) server_negotiation.cc:407] Connection header received
0811 07:03:40.843371 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:40.843378 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:40.843487 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:40.843582 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:40.844951 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.845877 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.847255 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:40.847751 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:40.847859 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:40.853909 (+ 6050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:50011: BlockingRecv error: recv got EOF from 127.30.73.66:50011 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 11 07:03:41 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:41 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:41.140125 9148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:41.128626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:35005)
0811 07:03:41.129257 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:41.129277 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:41.129480 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:41.129929 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:41.129934 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:41.130475 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:41.130694 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:41.130704 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.131965 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.131972 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:41.133142 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:41.133157 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.134155 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.134161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:41.134400 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:41.135205 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:41.135228 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:41.139750 (+ 4522us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":325,"threads_started":1}
W20260811 07:03:41.140329 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:41.128704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:35005 (local address 127.30.73.126:43655)
0811 07:03:41.128947 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:41.128955 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:41.129377 (+ 422us) server_negotiation.cc:407] Connection header received
0811 07:03:41.129624 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:41.129632 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:41.129710 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:41.129823 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:41.130853 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.131769 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.133298 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.133961 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.134138 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:41.140041 (+ 5903us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:35005: BlockingRecv error: recv got EOF from 127.30.73.67:35005 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 07:03:41 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:41 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:41.554618 9150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:41.543773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:37021)
0811 07:03:41.544438 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:41.544455 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:41.544673 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:41.545067 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:41.545072 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:41.545618 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:41.545887 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:41.545899 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.547025 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.547034 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:41.548052 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:41.548064 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.548930 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.548935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:41.549128 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:41.549990 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:41.550011 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:41.554315 (+ 4304us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":385,"threads_started":1}
W20260811 07:03:41.554804 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:41.543864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:37021 (local address 127.30.73.126:43655)
0811 07:03:41.544226 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:41.544234 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:41.544581 (+ 347us) server_negotiation.cc:407] Connection header received
0811 07:03:41.544811 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:41.544819 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:41.544910 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:41.545043 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:41.546040 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.546875 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.548199 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.548769 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.548913 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:41.554542 (+ 5629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:37021: BlockingRecv error: recv got EOF from 127.30.73.65:37021 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 07:03:41 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:41 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:41.865372 9151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:41.855399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:41411)
0811 07:03:41.855933 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:41.855951 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:41.856092 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:41.856443 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:41.856446 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:41.856884 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:41.857079 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:41.857089 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.858227 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.858231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:41.859183 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:41.859196 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.859954 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.859958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:41.860101 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:41.860873 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:41.860899 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:41.865088 (+ 4189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":287,"threads_started":1}
W20260811 07:03:41.865594 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:41.855521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:41411 (local address 127.30.73.126:43655)
0811 07:03:41.855815 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:41.855821 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:41.856034 (+ 213us) server_negotiation.cc:407] Connection header received
0811 07:03:41.856228 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:41.856232 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:41.856298 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:41.856384 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:41.857255 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.858032 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.859351 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:41.859819 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:41.859934 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:41.865320 (+ 5386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:41411: BlockingRecv error: recv got EOF from 127.30.73.66:41411 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 11 07:03:42 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:42 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:42.154721 9152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:42.141805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:60999)
0811 07:03:42.142670 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:42.142690 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:42.143001 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:42.143415 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:42.143419 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:42.143909 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:42.144095 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:42.144106 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.145186 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.145192 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:42.146187 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:42.146200 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.147004 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.147010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:42.147202 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:42.148196 (+ 994us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:42.148222 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:42.154293 (+ 6071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":709,"thread_start_us":564,"threads_started":1}
W20260811 07:03:42.154917 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:42.141946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:60999 (local address 127.30.73.126:43655)
0811 07:03:42.142262 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:42.142271 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:42.142898 (+ 627us) server_negotiation.cc:407] Connection header received
0811 07:03:42.143161 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:42.143166 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:42.143239 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:42.143356 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:42.144264 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.145028 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.146357 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.146797 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.146947 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:42.154582 (+ 7635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:60999: BlockingRecv error: recv got EOF from 127.30.73.67:60999 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
Aug 11 07:03:42 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:42 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:42.566511 9153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:42.556208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:32819)
0811 07:03:42.557016 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:42.557033 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:42.557227 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:42.557734 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:42.557739 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:42.558298 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:42.558502 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:42.558512 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.559613 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.559616 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:42.560580 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:42.560592 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.561347 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.561351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:42.561480 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:42.562168 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:42.562187 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:42.566096 (+ 3909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":545,"threads_started":1}
W20260811 07:03:42.566570 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:42.556330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:32819 (local address 127.30.73.126:43655)
0811 07:03:42.556555 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:42.556564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:42.557128 (+ 564us) server_negotiation.cc:407] Connection header received
0811 07:03:42.557402 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:42.557408 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:42.557534 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:42.557701 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:42.558667 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.559486 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.560782 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.561202 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.561311 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:42.566336 (+ 5025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:32819: BlockingRecv error: recv got EOF from 127.30.73.65:32819 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 07:03:42 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:42 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.66@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:42.878899 9154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:42.866713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.66:33695)
0811 07:03:42.867431 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:42.867451 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:42.867603 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:42.868083 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:42.868088 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:42.868626 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:42.868899 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:42.868913 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.870400 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.870406 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:42.871962 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:42.871986 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.872959 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.872964 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:42.873117 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:42.873903 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:42.873923 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:42.878569 (+ 4646us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":428,"threads_started":1}
W20260811 07:03:42.879144 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:42.866996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:33695 (local address 127.30.73.126:43655)
0811 07:03:42.867219 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:42.867225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:42.867546 (+ 321us) server_negotiation.cc:407] Connection header received
0811 07:03:42.867769 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:42.867774 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:42.867849 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:42.868002 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:42.869097 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.870217 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.872250 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:42.872779 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:42.872912 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:42.878855 (+ 5943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.66:33695: BlockingRecv error: recv got EOF from 127.30.73.66:33695 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 07:03:43 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:43 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.67@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:43.167567 9155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:43.156286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.67:54573)
0811 07:03:43.156931 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:43.156950 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:43.157098 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:43.157532 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:43.157536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:43.158112 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:43.158297 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:43.158307 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.159565 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.159570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:43.160878 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:43.160895 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.161740 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.161751 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:43.161951 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:43.162756 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:43.162777 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:43.167145 (+ 4368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":367,"threads_started":1}
W20260811 07:03:43.167697 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:43.156350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:54573 (local address 127.30.73.126:43655)
0811 07:03:43.156616 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:43.156623 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:43.157055 (+ 432us) server_negotiation.cc:407] Connection header received
0811 07:03:43.157221 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:43.157225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:43.157303 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:43.157400 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:43.158478 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.159354 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.161063 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.161558 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.161670 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:43.167423 (+ 5753us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.67:54573: BlockingRecv error: recv got EOF from 127.30.73.67:54573 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
Aug 11 07:03:43 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:03:43 dist-test-slave-69rg krb5kdc[7954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.73.65@KRBTEST.COM for oryx/127.30.73.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:03:43.579303 9156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:43.567840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43655 (local address 127.30.73.65:42893)
0811 07:03:43.568629 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:43.568650 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:43.568799 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:43.569313 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:43.569317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:43.570108 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:43.570336 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:43.570346 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.571658 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.571662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:43.572696 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:43.572708 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.573508 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.573513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:43.573653 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:43.574429 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:43.574449 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:43.578929 (+ 4480us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.73.126:43655: Server oryx/127.30.73.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":404,"threads_started":1}
W20260811 07:03:43.579736 9108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:43.568075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:42893 (local address 127.30.73.126:43655)
0811 07:03:43.568527 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:43.568538 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:43.568786 (+ 248us) server_negotiation.cc:407] Connection header received
0811 07:03:43.568932 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:43.568936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:43.569041 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:43.569135 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:43.570548 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.571490 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.572850 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.573365 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.573475 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:43.579311 (+ 5836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.73.65:42893: BlockingRecv error: recv got EOF from 127.30.73.65:42893 (error 108)
Metrics: {"server-negotiator.queue_time_us":295}
I20260811 07:03:43.680807 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8633
I20260811 07:03:43.696066 9159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:43.682509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33798 (local address 127.30.73.65:33441)
0811 07:03:43.683329 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:43.683337 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:43.683374 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:03:43.683449 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:43.683457 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:43.683742 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:43.683923 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:43.685594 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.686937 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.688361 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.689175 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.689300 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:43.692242 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:43.692253 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:43.692269 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:43.692320 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:43.695424 (+ 3104us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.73.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 07:03:43.695773 (+ 349us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33798: Request ticket server kudu/127.30.73.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":442,"threads_started":1}
W20260811 07:03:43.696246 9159 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33798: Request ticket server kudu/127.30.73.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 07:03:43.696237 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8633: Not authorized: Client connection negotiation failed: client connection to 127.30.73.65:33441: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.73.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 07:03:43.696501 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 8633
I20260811 07:03:43.718854 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8809
I20260811 07:03:43.734632 9161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:43.720197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40514 (local address 127.30.73.66:38629)
0811 07:03:43.720889 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:43.720897 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:43.720925 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:03:43.721009 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:43.721016 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:43.721254 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:43.721437 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:43.723626 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.724778 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.726320 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.727269 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.727408 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:43.730436 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:43.730446 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:43.730463 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:43.730509 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:43.733782 (+ 3273us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.73.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 07:03:43.734352 (+ 570us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40514: Request ticket server kudu/127.30.73.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":341,"threads_started":1}
W20260811 07:03:43.734730 9161 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40514: Request ticket server kudu/127.30.73.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 07:03:43.734941 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8809: Not authorized: Client connection negotiation failed: client connection to 127.30.73.66:38629: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.73.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 07:03:43.735126 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 8809
I20260811 07:03:43.759604 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8961
I20260811 07:03:43.774596 9162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:43.760983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52194 (local address 127.30.73.67:34777)
0811 07:03:43.761741 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:43.761750 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:43.761806 (+ 56us) server_negotiation.cc:407] Connection header received
0811 07:03:43.761935 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:43.761944 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:43.762258 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:43.762482 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:43.763842 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.765079 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.766371 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:43.766951 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:43.767062 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:43.769756 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:43.769765 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:43.769781 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:43.769926 (+ 145us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:43.773629 (+ 3703us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.73.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 07:03:43.774143 (+ 514us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52194: Request ticket server kudu/127.30.73.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":379,"threads_started":1}
W20260811 07:03:43.774734 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8961: Not authorized: Client connection negotiation failed: client connection to 127.30.73.67:34777: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.73.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 07:03:43.774923 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 8961
W20260811 07:03:43.775017 9162 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52194: Request ticket server kudu/127.30.73.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 07:03:43.800668 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 8554
I20260811 07:03:43.802291 8625 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:43.924401 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 8554
2026-08-11T07:03:43Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22129 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T07:03:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:03:43Z Disabled control of system clock
I20260811 07:03:44.025528 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40603
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:40603
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 07:03:44.379392 9167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:44.379683 9167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:44.379763 9167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:44.387355 9167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:44.387509 9167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:44.387588 9167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:44.387681 9167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:44.387755 9167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:44.397030 9167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:40603
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:44.398438 9167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:44.400132 9167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:44.414027 9172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:44.414261 9167 server_base.cc:1034] running on GCE node
W20260811 07:03:44.413990 9175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:44.413961 9173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:44.415380 9167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:44.416872 9167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:44.418159 9167 hybrid_clock.cc:648] HybridClock initialized: now 1786431824418121 us; error 55 us; skew 500 ppm
I20260811 07:03:44.418557 9167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:03:44.420933 9167 webserver.cc:460] Webserver started at http://127.30.73.126:36695/ using document root <none> and password file <none>
I20260811 07:03:44.421681 9167 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:44.421856 9167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:44.422223 9167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:44.425709 9167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "354f6424240a4a95a6d51c4458170749"
format_stamp: "Formatted at 2026-08-11 07:03:44 on dist-test-slave-69rg"
server_key: "bcee65bb8de7ae6dccedf502ccbce2a6"
server_key_iv: "8e6399cc0139507f2e79e3a35103732d"
server_key_version: "encryptionkey@0"
I20260811 07:03:44.426648 9167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "354f6424240a4a95a6d51c4458170749"
format_stamp: "Formatted at 2026-08-11 07:03:44 on dist-test-slave-69rg"
server_key: "bcee65bb8de7ae6dccedf502ccbce2a6"
server_key_iv: "8e6399cc0139507f2e79e3a35103732d"
server_key_version: "encryptionkey@0"
I20260811 07:03:44.431846 9167 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:03:44.435480 9182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:44.436779 9167 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:03:44.436976 9167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "354f6424240a4a95a6d51c4458170749"
format_stamp: "Formatted at 2026-08-11 07:03:44 on dist-test-slave-69rg"
server_key: "bcee65bb8de7ae6dccedf502ccbce2a6"
server_key_iv: "8e6399cc0139507f2e79e3a35103732d"
server_key_version: "encryptionkey@0"
I20260811 07:03:44.437213 9167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:44.452211 9167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:44.453054 9167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:44.453439 9167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:44.472783 9167 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:40603
I20260811 07:03:44.472820 9242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:40603 every 8 connection(s)
I20260811 07:03:44.474443 9167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:03:44.478291 9244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:44.484404 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 9167
I20260811 07:03:44.484614 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:03:44.485473 31013 external_mini_cluster.cc:1428] Setting key 96c44f91a7cd8447e6c7df28e696c88c
I20260811 07:03:44.490078 9244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749: Bootstrap starting.
I20260811 07:03:44.493338 9244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:44.494460 9244 log.cc:824] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:44.497908 9244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749: No bootstrap required, opened a new log
I20260811 07:03:44.500303 9247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:44.487913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47166 (local address 127.30.73.126:40603)
0811 07:03:44.488977 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:44.488989 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:44.489029 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:03:44.490953 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:44.490977 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:44.491441 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:44.491883 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:44.492557 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:44.494004 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:44.495734 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:44.496419 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:44.496563 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:44.497921 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:44.497931 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:44.497945 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:44.498569 (+ 624us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:44.498644 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:44.498668 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:44.498765 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:44.499009 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 07:03:44.499323 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":411,"threads_started":1}
I20260811 07:03:44.506552 9244 raft_consensus.cc:348] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f6424240a4a95a6d51c4458170749" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40603 } }
I20260811 07:03:44.506966 9244 raft_consensus.cc:374] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:44.507094 9244 raft_consensus.cc:729] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354f6424240a4a95a6d51c4458170749, State: Initialized, Role: FOLLOWER
I20260811 07:03:44.507652 9244 consensus_queue.cc:260] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f6424240a4a95a6d51c4458170749" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40603 } }
I20260811 07:03:44.507918 9244 raft_consensus.cc:388] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:03:44.508064 9244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:03:44.508265 9244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:44.510790 9244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f6424240a4a95a6d51c4458170749" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40603 } }
I20260811 07:03:44.511314 9244 leader_election.cc:302] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 354f6424240a4a95a6d51c4458170749; no voters:
I20260811 07:03:44.511912 9244 leader_election.cc:288] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:03:44.512085 9249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:44.512846 9249 raft_consensus.cc:686] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [term 1 LEADER]: Becoming Leader. State: Replica: 354f6424240a4a95a6d51c4458170749, State: Running, Role: LEADER
I20260811 07:03:44.513419 9249 consensus_queue.cc:237] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f6424240a4a95a6d51c4458170749" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40603 } }
I20260811 07:03:44.514094 9244 sys_catalog.cc:564] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:03:44.516436 9250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "354f6424240a4a95a6d51c4458170749" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f6424240a4a95a6d51c4458170749" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40603 } } }
I20260811 07:03:44.516819 9250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:44.516535 9251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 354f6424240a4a95a6d51c4458170749. Latest consensus state: current_term: 1 leader_uuid: "354f6424240a4a95a6d51c4458170749" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f6424240a4a95a6d51c4458170749" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40603 } } }
I20260811 07:03:44.516952 9251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:44.519083 9256 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:03:44.524528 9256 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:03:44.535065 9256 catalog_manager.cc:1347] Generated new cluster ID: 28b8d20d086643768aea530c70bffd56
I20260811 07:03:44.535181 9256 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:03:44.547063 9256 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:03:44.548401 9256 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:03:44.554719 9256 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 354f6424240a4a95a6d51c4458170749: Generated new TSK 0
I20260811 07:03:44.555809 9256 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:03:44.562168 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40603
--builtin_ntp_servers=127.30.73.84:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 07:03:44.909140 9272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:44.909487 9272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:44.909655 9272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:44.917156 9272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:44.917315 9272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:44.917488 9272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:03:44.927168 9272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:44.928503 9272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:44.930423 9272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:44.944108 9277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:44.944216 9280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:44.944029 9278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:44.945045 9272 server_base.cc:1034] running on GCE node
I20260811 07:03:44.945700 9272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:44.946751 9272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:44.947974 9272 hybrid_clock.cc:648] HybridClock initialized: now 1786431824947932 us; error 29 us; skew 500 ppm
I20260811 07:03:44.948349 9272 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:03:44.955384 9272 webserver.cc:460] Webserver started at http://127.30.73.65:36063/ using document root <none> and password file <none>
I20260811 07:03:44.956197 9272 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:44.956305 9272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:44.956687 9272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:44.960003 9272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "1f331c2bcc574502ac06b15d2b98968a"
format_stamp: "Formatted at 2026-08-11 07:03:44 on dist-test-slave-69rg"
server_key: "c844b3d4bf9f3e62ea118c06438315a7"
server_key_iv: "5b3b52b3359556c10f8e295f6876f871"
server_key_version: "encryptionkey@0"
I20260811 07:03:44.960966 9272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "1f331c2bcc574502ac06b15d2b98968a"
format_stamp: "Formatted at 2026-08-11 07:03:44 on dist-test-slave-69rg"
server_key: "c844b3d4bf9f3e62ea118c06438315a7"
server_key_iv: "5b3b52b3359556c10f8e295f6876f871"
server_key_version: "encryptionkey@0"
I20260811 07:03:44.966766 9272 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 07:03:44.970348 9286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:44.971812 9272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 07:03:44.972010 9272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "1f331c2bcc574502ac06b15d2b98968a"
format_stamp: "Formatted at 2026-08-11 07:03:44 on dist-test-slave-69rg"
server_key: "c844b3d4bf9f3e62ea118c06438315a7"
server_key_iv: "5b3b52b3359556c10f8e295f6876f871"
server_key_version: "encryptionkey@0"
I20260811 07:03:44.972257 9272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:44.990597 9272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:44.991493 9272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:44.991822 9272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:44.992822 9272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:44.994369 9272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:44.994462 9272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:44.994599 9272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:44.994688 9272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:45.032259 9272 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:40163
I20260811 07:03:45.032339 9412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:40163 every 8 connection(s)
I20260811 07:03:45.033595 9272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:03:45.043375 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 9272
I20260811 07:03:45.043609 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:03:45.044312 31013 external_mini_cluster.cc:1428] Setting key e26e99fe95b51448c03ba62c69a93f8d
I20260811 07:03:45.047811 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40603
--builtin_ntp_servers=127.30.73.84:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 07:03:45.048099 9415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:45.036185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:55951 (local address 127.30.73.126:40603)
0811 07:03:45.036690 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:45.036697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:45.037882 (+ 1185us) server_negotiation.cc:407] Connection header received
0811 07:03:45.039613 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:45.039618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:45.039692 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:45.039799 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:45.041127 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:45.042370 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:45.044731 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:45.045237 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:45.045421 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:45.047147 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:45.047153 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:45.047156 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:45.047174 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:45.047222 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:45.047262 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:45.047335 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:45.047666 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 07:03:45.047756 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":228,"threads_started":1}
I20260811 07:03:45.049870 9416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:45.036802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40603 (local address 127.30.73.65:55951)
0811 07:03:45.037682 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:45.037728 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:45.039341 (+ 1613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:45.040009 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:45.040017 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:45.040099 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:45.040797 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:45.040816 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:45.042572 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:45.042576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:45.044550 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:45.044572 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:45.045524 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:45.045534 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:45.045881 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:45.046732 (+ 851us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:03:45.046737 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:45.046806 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:03:45.046923 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:45.047377 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:45.047392 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:45.047403 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:03:45.047637 (+ 234us) client_negotiation.cc:240] Negotiation successful
0811 07:03:45.048147 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":274,"threads_started":1}
I20260811 07:03:45.051810 9413 heartbeater.cc:347] Connected to a master server at 127.30.73.126:40603
I20260811 07:03:45.052146 9413 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:45.052990 9413 heartbeater.cc:511] Master 127.30.73.126:40603 requested a full tablet report, sending...
I20260811 07:03:45.055326 9203 ts_manager.cc:194] Registered new tserver with Master: 1f331c2bcc574502ac06b15d2b98968a (127.30.73.65:40163)
I20260811 07:03:45.056810 9203 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.65:55951
W20260811 07:03:45.407327 9418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:45.407629 9418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:45.407716 9418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:45.415181 9418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:45.415383 9418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:45.415565 9418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:03:45.425189 9418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:45.426671 9418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:45.428530 9418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:45.442718 9423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:45.442762 9426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:45.442675 9424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:45.444165 9418 server_base.cc:1034] running on GCE node
I20260811 07:03:45.445010 9418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:45.446534 9418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:45.447835 9418 hybrid_clock.cc:648] HybridClock initialized: now 1786431825447785 us; error 57 us; skew 500 ppm
I20260811 07:03:45.448244 9418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:03:45.450771 9418 webserver.cc:460] Webserver started at http://127.30.73.66:36789/ using document root <none> and password file <none>
I20260811 07:03:45.451558 9418 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:45.451717 9418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:45.452077 9418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:45.455257 9418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "f74f51a1681844358042840119c73c30"
format_stamp: "Formatted at 2026-08-11 07:03:45 on dist-test-slave-69rg"
server_key: "4ba97e12eea6d06e52d2db849591255d"
server_key_iv: "be3935894b4b46be267d319e8d9ea6ed"
server_key_version: "encryptionkey@0"
I20260811 07:03:45.456195 9418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "f74f51a1681844358042840119c73c30"
format_stamp: "Formatted at 2026-08-11 07:03:45 on dist-test-slave-69rg"
server_key: "4ba97e12eea6d06e52d2db849591255d"
server_key_iv: "be3935894b4b46be267d319e8d9ea6ed"
server_key_version: "encryptionkey@0"
I20260811 07:03:45.461915 9418 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:03:45.465801 9433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:45.467378 9418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:03:45.467612 9418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "f74f51a1681844358042840119c73c30"
format_stamp: "Formatted at 2026-08-11 07:03:45 on dist-test-slave-69rg"
server_key: "4ba97e12eea6d06e52d2db849591255d"
server_key_iv: "be3935894b4b46be267d319e8d9ea6ed"
server_key_version: "encryptionkey@0"
I20260811 07:03:45.467867 9418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:45.498557 9418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:45.499495 9418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:45.499837 9418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:45.500861 9418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:45.502395 9418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:45.502529 9418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:45.502671 9418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:45.502761 9418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:45.540637 9418 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:41615
I20260811 07:03:45.540732 9560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:41615 every 8 connection(s)
I20260811 07:03:45.542359 9418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:03:45.550436 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 9418
I20260811 07:03:45.550580 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:03:45.551229 31013 external_mini_cluster.cc:1428] Setting key 61835438c48cfa4478f8f1aebfbb0f77
I20260811 07:03:45.554576 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40603
--builtin_ntp_servers=127.30.73.84:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 07:03:45.557307 9415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:45.545258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:41901 (local address 127.30.73.126:40603)
0811 07:03:45.545471 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:45.545475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:45.546977 (+ 1502us) server_negotiation.cc:407] Connection header received
0811 07:03:45.549105 (+ 2128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:45.549110 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:45.549226 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:45.549322 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:45.550886 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:45.551963 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:45.554009 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:45.554401 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:45.554546 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:45.556472 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:45.556477 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:45.556480 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:45.556499 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:45.556533 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:45.556545 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:45.556647 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:45.556907 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 07:03:45.557005 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:03:45.558498 9563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:45.545713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40603 (local address 127.30.73.66:41901)
0811 07:03:45.546776 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:45.546813 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:45.548783 (+ 1970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:45.549578 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:45.549588 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:45.549691 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:45.550678 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:45.550711 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:45.552152 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:45.552158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:45.553794 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:45.553808 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:45.554648 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:45.554655 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:45.554960 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:45.555803 (+ 843us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:03:45.556007 (+ 204us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:45.556134 (+ 127us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:03:45.556267 (+ 133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:45.556649 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:45.556663 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:45.556673 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:03:45.556880 (+ 207us) client_negotiation.cc:240] Negotiation successful
0811 07:03:45.557327 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":343,"threads_started":1}
I20260811 07:03:45.560155 9561 heartbeater.cc:347] Connected to a master server at 127.30.73.126:40603
I20260811 07:03:45.560542 9561 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:45.561409 9561 heartbeater.cc:511] Master 127.30.73.126:40603 requested a full tablet report, sending...
I20260811 07:03:45.563079 9203 ts_manager.cc:194] Registered new tserver with Master: f74f51a1681844358042840119c73c30 (127.30.73.66:41615)
I20260811 07:03:45.564011 9203 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.66:41901
W20260811 07:03:45.922453 9564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:45.922801 9564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:45.922948 9564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:45.931351 9564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:45.931486 9564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:45.931686 9564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:03:45.942399 9564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:45.943804 9564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:45.945705 9564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:45.960490 9569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:45.960714 9570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:45.960839 9572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:45.961573 9564 server_base.cc:1034] running on GCE node
I20260811 07:03:45.962347 9564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:45.963418 9564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:45.964690 9564 hybrid_clock.cc:648] HybridClock initialized: now 1786431825964629 us; error 37 us; skew 500 ppm
I20260811 07:03:45.965054 9564 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:03:45.967572 9564 webserver.cc:460] Webserver started at http://127.30.73.67:38451/ using document root <none> and password file <none>
I20260811 07:03:45.968314 9564 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:45.968459 9564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:45.968807 9564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:45.971911 9564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "77b74d6e5f694b518ba51d9191623334"
format_stamp: "Formatted at 2026-08-11 07:03:45 on dist-test-slave-69rg"
server_key: "5a3fb578c0d7207b2e95046c044be14f"
server_key_iv: "6e7738ff7781640fafa7dd0c62f1b3d2"
server_key_version: "encryptionkey@0"
I20260811 07:03:45.972769 9564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "77b74d6e5f694b518ba51d9191623334"
format_stamp: "Formatted at 2026-08-11 07:03:45 on dist-test-slave-69rg"
server_key: "5a3fb578c0d7207b2e95046c044be14f"
server_key_iv: "6e7738ff7781640fafa7dd0c62f1b3d2"
server_key_version: "encryptionkey@0"
I20260811 07:03:45.980495 9564 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.008s
I20260811 07:03:45.984939 9579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:45.987128 9564 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 07:03:45.987490 9564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "77b74d6e5f694b518ba51d9191623334"
format_stamp: "Formatted at 2026-08-11 07:03:45 on dist-test-slave-69rg"
server_key: "5a3fb578c0d7207b2e95046c044be14f"
server_key_iv: "6e7738ff7781640fafa7dd0c62f1b3d2"
server_key_version: "encryptionkey@0"
I20260811 07:03:45.987892 9564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:46.008174 9564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:46.009361 9564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:46.009735 9564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:46.011081 9564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:46.013389 9564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:46.013535 9564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:46.013960 9564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:46.014076 9564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:46.060524 9413 heartbeater.cc:503] Master 127.30.73.126:40603 was elected leader, sending a full tablet report...
I20260811 07:03:46.061619 9564 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:41255
I20260811 07:03:46.061745 9709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:41255 every 8 connection(s)
I20260811 07:03:46.064543 9564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:03:46.068327 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 9564
I20260811 07:03:46.068660 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:03:46.069334 31013 external_mini_cluster.cc:1428] Setting key 70159f52eafd0a5104bf2e462e61cb65
I20260811 07:03:46.089969 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:46.069259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:45809 (local address 127.30.73.126:40603)
0811 07:03:46.075220 (+ 5961us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:46.075226 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:46.079381 (+ 4155us) server_negotiation.cc:407] Connection header received
0811 07:03:46.081415 (+ 2034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:46.081419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:46.081506 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:46.081627 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:46.083053 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.083904 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.086646 (+ 2742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.087089 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.087200 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:46.088921 (+ 1721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:46.088926 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:46.088929 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:46.088949 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:46.088996 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:46.089009 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:46.089096 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:46.089479 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 07:03:46.089571 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5815,"thread_start_us":5645,"threads_started":1}
I20260811 07:03:46.091773 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:46.070192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40603 (local address 127.30.73.67:45809)
0811 07:03:46.079028 (+ 8836us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:46.079085 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:46.081111 (+ 2026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:46.082012 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:46.082022 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:46.082161 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:46.082815 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:46.082834 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.084089 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.084093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:46.086480 (+ 2387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:46.086496 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.087383 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.087389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:46.087611 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:46.088531 (+ 920us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:03:46.088534 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:46.088580 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:03:46.088671 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:46.089178 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:46.089191 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:46.089199 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:03:46.089402 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 07:03:46.089742 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8055,"thread_start_us":7791,"threads_started":1}
I20260811 07:03:46.094002 9710 heartbeater.cc:347] Connected to a master server at 127.30.73.126:40603
I20260811 07:03:46.094362 9710 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:46.095463 9710 heartbeater.cc:511] Master 127.30.73.126:40603 requested a full tablet report, sending...
I20260811 07:03:46.097723 9203 ts_manager.cc:194] Registered new tserver with Master: 77b74d6e5f694b518ba51d9191623334 (127.30.73.67:41255)
I20260811 07:03:46.098809 9203 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.67:45809
I20260811 07:03:46.099977 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:03:46.109071 9712 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:46.107229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47172 (local address 127.30.73.126:40603)
0811 07:03:46.107454 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:46.107458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:46.107938 (+ 480us) server_negotiation.cc:407] Connection header received
0811 07:03:46.108069 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:46.108072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:46.108148 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:46.108248 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:46.108784 (+ 536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47172: BlockingRecv error: recv got EOF from 127.0.0.1:47172 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 07:03:46.109969 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 9272
I20260811 07:03:46.119277 9722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:46.111110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42440 (local address 127.30.73.65:40163)
0811 07:03:46.111684 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:46.111691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:46.111718 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:03:46.111775 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:46.111782 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:46.111988 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:46.112112 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:46.112615 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.114159 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.115694 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.116334 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.116467 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:46.117682 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:46.117691 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:46.117708 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:46.118435 (+ 727us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:46.118485 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:46.118505 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:46.118601 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:46.118851 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 07:03:46.118977 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":269,"threads_started":1}
I20260811 07:03:46.120738 9408 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:46.214241 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 9272
I20260811 07:03:46.237303 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 9418
I20260811 07:03:46.246383 9725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:46.238631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60490 (local address 127.30.73.66:41615)
0811 07:03:46.239324 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:46.239332 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:46.239362 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:03:46.239437 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:46.239444 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:46.239675 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:46.239906 (+ 231us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:46.240346 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.241429 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.242840 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.243427 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.243592 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:46.244731 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:46.244741 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:46.244757 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:46.245426 (+ 669us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:46.245477 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:46.245499 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:46.245660 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:46.245860 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 07:03:46.246003 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":372,"threads_started":1}
I20260811 07:03:46.247848 9556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:46.333465 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 9418
I20260811 07:03:46.357901 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 9564
I20260811 07:03:46.366720 9727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:46.359119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52386 (local address 127.30.73.67:41255)
0811 07:03:46.359828 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:46.359835 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:46.359867 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:03:46.359970 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:46.359977 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:46.360188 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:46.360370 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:46.360840 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.362014 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.363259 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:46.363822 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:46.363969 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:46.365150 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:46.365159 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:46.365173 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:46.365770 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:46.365879 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:46.365908 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:46.366033 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:46.366190 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 07:03:46.366352 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":427,"threads_started":1}
I20260811 07:03:46.368185 9704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:46.451908 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 9564
I20260811 07:03:46.473061 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 9167
I20260811 07:03:46.474393 9238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:46.580396 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 9167
2026-08-11T07:03:46Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2648 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T07:03:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:03:46Z Disabled control of system clock
I20260811 07:03:46.669094 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35155
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:34513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:35155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 07:03:47.016413 9733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:47.016701 9733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:47.016855 9733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:47.024276 9733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:47.024381 9733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:47.024447 9733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:47.024549 9733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:47.024633 9733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:47.033780 9733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:34513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:35155
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:47.035167 9733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:47.036938 9733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:47.049101 9738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:47.049077 9739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:47.049016 9741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:47.049774 9733 server_base.cc:1034] running on GCE node
I20260811 07:03:47.050709 9733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:47.052172 9733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:47.053443 9733 hybrid_clock.cc:648] HybridClock initialized: now 1786431827053394 us; error 58 us; skew 500 ppm
I20260811 07:03:47.053897 9733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:03:47.060521 9733 webserver.cc:460] Webserver started at http://127.30.73.126:35393/ using document root <none> and password file <none>
I20260811 07:03:47.061280 9733 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:47.061426 9733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:47.061792 9733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:47.064980 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "497563502b6e421f9175cb6573926fd3"
format_stamp: "Formatted at 2026-08-11 07:03:47 on dist-test-slave-69rg"
server_key: "fed56e1085628965908b3b1d81bd416b"
server_key_iv: "0eadcad87f56e5d18383f31a295b6074"
server_key_version: "encryptionkey@0"
I20260811 07:03:47.065876 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "497563502b6e421f9175cb6573926fd3"
format_stamp: "Formatted at 2026-08-11 07:03:47 on dist-test-slave-69rg"
server_key: "fed56e1085628965908b3b1d81bd416b"
server_key_iv: "0eadcad87f56e5d18383f31a295b6074"
server_key_version: "encryptionkey@0"
I20260811 07:03:47.071350 9733 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 07:03:47.075033 9747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:47.076562 9733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:03:47.076781 9733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "497563502b6e421f9175cb6573926fd3"
format_stamp: "Formatted at 2026-08-11 07:03:47 on dist-test-slave-69rg"
server_key: "fed56e1085628965908b3b1d81bd416b"
server_key_iv: "0eadcad87f56e5d18383f31a295b6074"
server_key_version: "encryptionkey@0"
I20260811 07:03:47.077028 9733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:47.083164 9733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:47.083982 9733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:47.084340 9733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:47.104578 9733 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:35155
I20260811 07:03:47.104633 9805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:35155 every 8 connection(s)
I20260811 07:03:47.106030 9733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:03:47.106789 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 9733
I20260811 07:03:47.107070 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:03:47.107877 31013 external_mini_cluster.cc:1428] Setting key d4ff443aaf48a34fbaa11137ab976b41
I20260811 07:03:47.110889 9806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:47.117846 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:47.110249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53316 (local address 127.30.73.126:35155)
0811 07:03:47.111367 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:47.111381 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:47.111434 (+ 53us) server_negotiation.cc:407] Connection header received
0811 07:03:47.113705 (+ 2271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:47.113730 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:47.114290 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:47.114734 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:47.115754 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:47.115765 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:47.115781 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:47.115799 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:47.115889 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:47.115914 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:47.116161 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:47.116288 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 07:03:47.116551 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":362,"threads_started":1}
I20260811 07:03:47.126497 9806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3: Bootstrap starting.
I20260811 07:03:47.131223 9806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:47.132773 9806 log.cc:824] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:47.136832 9806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3: No bootstrap required, opened a new log
I20260811 07:03:47.146083 9806 raft_consensus.cc:348] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497563502b6e421f9175cb6573926fd3" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35155 } }
I20260811 07:03:47.146515 9806 raft_consensus.cc:374] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:47.146642 9806 raft_consensus.cc:729] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497563502b6e421f9175cb6573926fd3, State: Initialized, Role: FOLLOWER
I20260811 07:03:47.147377 9806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497563502b6e421f9175cb6573926fd3" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35155 } }
I20260811 07:03:47.147671 9806 raft_consensus.cc:388] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:03:47.147816 9806 raft_consensus.cc:482] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:03:47.148015 9806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:47.151506 9806 raft_consensus.cc:504] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497563502b6e421f9175cb6573926fd3" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35155 } }
I20260811 07:03:47.152241 9806 leader_election.cc:302] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 497563502b6e421f9175cb6573926fd3; no voters:
I20260811 07:03:47.152974 9806 leader_election.cc:288] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:03:47.153132 9812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:47.153905 9812 raft_consensus.cc:686] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [term 1 LEADER]: Becoming Leader. State: Replica: 497563502b6e421f9175cb6573926fd3, State: Running, Role: LEADER
I20260811 07:03:47.154454 9812 consensus_queue.cc:237] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497563502b6e421f9175cb6573926fd3" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35155 } }
I20260811 07:03:47.155499 9806 sys_catalog.cc:564] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:03:47.157092 9814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "497563502b6e421f9175cb6573926fd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497563502b6e421f9175cb6573926fd3" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35155 } } }
I20260811 07:03:47.157500 9814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:47.158336 9815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 497563502b6e421f9175cb6573926fd3. Latest consensus state: current_term: 1 leader_uuid: "497563502b6e421f9175cb6573926fd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "497563502b6e421f9175cb6573926fd3" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35155 } } }
I20260811 07:03:47.158686 9815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:47.159258 9818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:03:47.174185 9818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:03:47.185352 9818 catalog_manager.cc:1347] Generated new cluster ID: 77bce204e6bc412c80910351f3591679
I20260811 07:03:47.185508 9818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:03:47.198438 9818 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:03:47.198959 9818 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:03:47.213366 9818 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 497563502b6e421f9175cb6573926fd3: Generated new TSK 0
I20260811 07:03:47.214728 9818 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:03:47.219792 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35155
--builtin_ntp_servers=127.30.73.84:34513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 07:03:47.579355 9835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:47.579697 9835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:47.579864 9835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:47.587586 9835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:47.587738 9835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:47.587909 9835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:03:47.597173 9835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:34513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:47.598570 9835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:47.600449 9835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:47.614455 9844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:47.614532 9841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:47.614552 9840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:47.615361 9835 server_base.cc:1034] running on GCE node
I20260811 07:03:47.616073 9835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:47.617311 9835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:47.618597 9835 hybrid_clock.cc:648] HybridClock initialized: now 1786431827618556 us; error 66 us; skew 500 ppm
I20260811 07:03:47.618956 9835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:03:47.621405 9835 webserver.cc:460] Webserver started at http://127.30.73.65:35495/ using document root <none> and password file <none>
I20260811 07:03:47.622239 9835 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:47.622385 9835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:47.622740 9835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:47.625746 9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "48a89ba8445947d391f0359e7a74806f"
format_stamp: "Formatted at 2026-08-11 07:03:47 on dist-test-slave-69rg"
server_key: "becc1922b0dee07485d044ddf10df022"
server_key_iv: "33d95076b9d49ab74426bb4db158c94b"
server_key_version: "encryptionkey@0"
I20260811 07:03:47.626627 9835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "48a89ba8445947d391f0359e7a74806f"
format_stamp: "Formatted at 2026-08-11 07:03:47 on dist-test-slave-69rg"
server_key: "becc1922b0dee07485d044ddf10df022"
server_key_iv: "33d95076b9d49ab74426bb4db158c94b"
server_key_version: "encryptionkey@0"
I20260811 07:03:47.632023 9835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:03:47.635634 9850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:47.637027 9835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:03:47.637208 9835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "48a89ba8445947d391f0359e7a74806f"
format_stamp: "Formatted at 2026-08-11 07:03:47 on dist-test-slave-69rg"
server_key: "becc1922b0dee07485d044ddf10df022"
server_key_iv: "33d95076b9d49ab74426bb4db158c94b"
server_key_version: "encryptionkey@0"
I20260811 07:03:47.637447 9835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:47.643882 9835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:47.644752 9835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:47.644994 9835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:47.646044 9835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:47.647617 9835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:47.647709 9835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:47.647797 9835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:47.647855 9835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:47.683537 9835 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:45437
I20260811 07:03:47.683593 9978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:45437 every 8 connection(s)
I20260811 07:03:47.684979 9835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:03:47.690337 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 9835
I20260811 07:03:47.690560 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:03:47.691200 31013 external_mini_cluster.cc:1428] Setting key 94e633089af4ca5eaffa6ef7db27da08
I20260811 07:03:47.693488 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:47.687627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:38935 (local address 127.30.73.126:35155)
0811 07:03:47.688114 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:47.688118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:47.689120 (+ 1002us) server_negotiation.cc:407] Connection header received
0811 07:03:47.691097 (+ 1977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:47.691103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:47.691191 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:47.691315 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:47.692671 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:47.692678 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:47.692682 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:47.692707 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:47.692749 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:47.692761 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:47.692901 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:47.693096 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 07:03:47.693176 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":264,"threads_started":1}
I20260811 07:03:47.694309 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35155
--builtin_ntp_servers=127.30.73.84:34513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 07:03:47.694608 9982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:47.688088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35155 (local address 127.30.73.65:38935)
0811 07:03:47.688966 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:47.689001 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:47.690812 (+ 1811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:47.691570 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:47.691579 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:47.691680 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:47.692360 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:03:47.692363 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:47.692400 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:03:47.692488 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:47.692866 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:47.692878 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:47.692888 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:03:47.693184 (+ 296us) client_negotiation.cc:240] Negotiation successful
0811 07:03:47.693443 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":274,"threads_started":1}
I20260811 07:03:47.696316 9979 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35155
I20260811 07:03:47.696655 9979 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:47.697322 9979 heartbeater.cc:511] Master 127.30.73.126:35155 requested a full tablet report, sending...
I20260811 07:03:47.699697 9764 ts_manager.cc:194] Registered new tserver with Master: 48a89ba8445947d391f0359e7a74806f (127.30.73.65:45437)
W20260811 07:03:48.056432 9983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:48.056823 9983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:48.057005 9983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:48.067749 9983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:48.067898 9983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:48.068081 9983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:03:48.078996 9983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:34513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:48.080538 9983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:48.082649 9983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:48.096541 9988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:48.096642 9990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:48.096670 9992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:48.097363 9983 server_base.cc:1034] running on GCE node
I20260811 07:03:48.098137 9983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:48.099184 9983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:48.100452 9983 hybrid_clock.cc:648] HybridClock initialized: now 1786431828100344 us; error 55 us; skew 500 ppm
I20260811 07:03:48.100828 9983 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:03:48.103335 9983 webserver.cc:460] Webserver started at http://127.30.73.66:40011/ using document root <none> and password file <none>
I20260811 07:03:48.104111 9983 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:48.104223 9983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:48.104589 9983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:48.107540 9983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "51331ad15b3d4bdd83679f99bd6924e6"
format_stamp: "Formatted at 2026-08-11 07:03:48 on dist-test-slave-69rg"
server_key: "a30c52a293c5a57c4b85f75998c5cd15"
server_key_iv: "8d8a2748e9c0b9bc3f4c9b1ac6ae1ab9"
server_key_version: "encryptionkey@0"
I20260811 07:03:48.108357 9983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "51331ad15b3d4bdd83679f99bd6924e6"
format_stamp: "Formatted at 2026-08-11 07:03:48 on dist-test-slave-69rg"
server_key: "a30c52a293c5a57c4b85f75998c5cd15"
server_key_iv: "8d8a2748e9c0b9bc3f4c9b1ac6ae1ab9"
server_key_version: "encryptionkey@0"
I20260811 07:03:48.114060 9983 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 07:03:48.117868 9999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:48.119359 9983 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:48.119536 9983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "51331ad15b3d4bdd83679f99bd6924e6"
format_stamp: "Formatted at 2026-08-11 07:03:48 on dist-test-slave-69rg"
server_key: "a30c52a293c5a57c4b85f75998c5cd15"
server_key_iv: "8d8a2748e9c0b9bc3f4c9b1ac6ae1ab9"
server_key_version: "encryptionkey@0"
I20260811 07:03:48.119771 9983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:48.125593 9983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:48.126461 9983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:48.126775 9983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:48.127717 9983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:48.129132 9983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:48.129230 9983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:48.129391 9983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:48.129484 9983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:48.168244 9983 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:46673
I20260811 07:03:48.168287 10131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:46673 every 8 connection(s)
I20260811 07:03:48.169659 9983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:03:48.176277 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 9983
I20260811 07:03:48.176478 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:03:48.177104 31013 external_mini_cluster.cc:1428] Setting key 89267888b9ef8f5661afdd73b2efe73f
I20260811 07:03:48.178436 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:48.172429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:48017 (local address 127.30.73.126:35155)
0811 07:03:48.172623 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:48.172628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:48.174071 (+ 1443us) server_negotiation.cc:407] Connection header received
0811 07:03:48.175844 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:48.175850 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:48.175924 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:48.176037 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:48.177593 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:48.177598 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:48.177601 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:48.177618 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:48.177649 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:48.177660 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:48.177844 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:48.178048 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 07:03:48.178141 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:03:48.179364 10135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:48.172928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35155 (local address 127.30.73.66:48017)
0811 07:03:48.173923 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:48.173959 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:48.175553 (+ 1594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:48.176271 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:48.176280 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:48.176398 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:48.177205 (+ 807us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:03:48.177209 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:48.177301 (+ 92us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:03:48.177406 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:48.177793 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:48.177805 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:48.177834 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:03:48.178153 (+ 319us) client_negotiation.cc:240] Negotiation successful
0811 07:03:48.178414 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":294,"threads_started":1}
I20260811 07:03:48.180696 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35155
--builtin_ntp_servers=127.30.73.84:34513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 07:03:48.180866 10132 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35155
I20260811 07:03:48.181216 10132 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:48.182011 10132 heartbeater.cc:511] Master 127.30.73.126:35155 requested a full tablet report, sending...
I20260811 07:03:48.183539 9764 ts_manager.cc:194] Registered new tserver with Master: 51331ad15b3d4bdd83679f99bd6924e6 (127.30.73.66:46673)
W20260811 07:03:48.533056 10136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:48.533377 10136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:48.533529 10136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:48.541539 10136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:48.541671 10136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:48.541921 10136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:03:48.552171 10136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:34513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:48.553660 10136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:48.555603 10136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:48.570330 10143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:48.570830 10147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:48.570864 10144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:48.571822 10136 server_base.cc:1034] running on GCE node
I20260811 07:03:48.572512 10136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:48.573536 10136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:48.574800 10136 hybrid_clock.cc:648] HybridClock initialized: now 1786431828574725 us; error 64 us; skew 500 ppm
I20260811 07:03:48.575233 10136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:03:48.578164 10136 webserver.cc:460] Webserver started at http://127.30.73.67:34219/ using document root <none> and password file <none>
I20260811 07:03:48.578962 10136 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:48.579124 10136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:48.579486 10136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:48.582860 10136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "97f8fd52228e40678e13bf7cd72cc9f9"
format_stamp: "Formatted at 2026-08-11 07:03:48 on dist-test-slave-69rg"
server_key: "73c3d5f9d0aa2a829f60c66bda170154"
server_key_iv: "56039a62475d942bf7ed87660d1d397e"
server_key_version: "encryptionkey@0"
I20260811 07:03:48.583693 10136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "97f8fd52228e40678e13bf7cd72cc9f9"
format_stamp: "Formatted at 2026-08-11 07:03:48 on dist-test-slave-69rg"
server_key: "73c3d5f9d0aa2a829f60c66bda170154"
server_key_iv: "56039a62475d942bf7ed87660d1d397e"
server_key_version: "encryptionkey@0"
I20260811 07:03:48.589259 10136 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 07:03:48.593050 10153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:48.594486 10136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:03:48.594683 10136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "97f8fd52228e40678e13bf7cd72cc9f9"
format_stamp: "Formatted at 2026-08-11 07:03:48 on dist-test-slave-69rg"
server_key: "73c3d5f9d0aa2a829f60c66bda170154"
server_key_iv: "56039a62475d942bf7ed87660d1d397e"
server_key_version: "encryptionkey@0"
I20260811 07:03:48.594935 10136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:48.601341 10136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:48.602383 10136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:48.602710 10136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:48.603799 10136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:48.605505 10136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:48.605652 10136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:48.605801 10136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:48.605998 10136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260811 07:03:48.646377 10288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:40001 every 8 connection(s)
I20260811 07:03:48.646689 10136 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:40001
I20260811 07:03:48.648000 10136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:03:48.651957 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 10136
I20260811 07:03:48.652159 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:03:48.652704 31013 external_mini_cluster.cc:1428] Setting key 59e9ffd3fa8000a8b54aec41f03d2b7e
I20260811 07:03:48.657545 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:48.650822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:51893 (local address 127.30.73.126:35155)
0811 07:03:48.651031 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:48.651035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:48.652797 (+ 1762us) server_negotiation.cc:407] Connection header received
0811 07:03:48.655146 (+ 2349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:48.655154 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:48.655231 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:48.655348 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:48.656828 (+ 1480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:48.656833 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:48.656836 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:48.656853 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:48.656914 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:48.656926 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:48.657061 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:48.657263 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 07:03:48.657317 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:03:48.658568 10292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:48.651350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35155 (local address 127.30.73.67:51893)
0811 07:03:48.652553 (+ 1203us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:48.652599 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:48.654824 (+ 2225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:48.655555 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:48.655563 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:48.655651 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:48.656525 (+ 874us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:03:48.656527 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:48.656566 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:03:48.656651 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:48.657052 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:48.657063 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:48.657074 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:03:48.657333 (+ 259us) client_negotiation.cc:240] Negotiation successful
0811 07:03:48.657539 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":339,"threads_started":1}
I20260811 07:03:48.660080 10290 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35155
I20260811 07:03:48.660375 10290 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:48.660919 10290 heartbeater.cc:511] Master 127.30.73.126:35155 requested a full tablet report, sending...
I20260811 07:03:48.662381 9764 ts_manager.cc:194] Registered new tserver with Master: 97f8fd52228e40678e13bf7cd72cc9f9 (127.30.73.67:40001)
I20260811 07:03:48.668576 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:03:48.675202 9981 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:03:48.673430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53324 (local address 127.30.73.126:35155)
0811 07:03:48.673858 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:48.673868 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:48.674245 (+ 377us) server_negotiation.cc:407] Connection header received
0811 07:03:48.674379 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:48.674382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:48.674435 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:48.674513 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:48.674906 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53324: BlockingRecv error: recv got EOF from 127.0.0.1:53324 (error 108)
Metrics: {"server-negotiator.queue_time_us":229}
I20260811 07:03:48.676317 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 9835
I20260811 07:03:48.679862 10299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:48.677295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41414 (local address 127.30.73.65:45437)
0811 07:03:48.677890 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:48.677899 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:48.677933 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:03:48.677993 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:48.677999 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:48.678241 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:48.678367 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:48.679261 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:48.679267 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:48.679278 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:48.679295 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:48.679333 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:48.679346 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:48.679451 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:48.679531 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 07:03:48.679616 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":269,"threads_started":1}
I20260811 07:03:48.681159 9974 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:48.761950 9979 heartbeater.cc:503] Master 127.30.73.126:35155 was elected leader, sending a full tablet report...
I20260811 07:03:48.763425 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 9835
W20260811 07:03:48.783361 9748 connection.cc:535] server connection from 127.30.73.65:38935 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:03:48.783581 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 9983
I20260811 07:03:48.787851 10301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:48.784746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40986 (local address 127.30.73.66:46673)
0811 07:03:48.785456 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:48.785471 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:48.785498 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:03:48.785565 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:48.785571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:48.785801 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:48.786032 (+ 231us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:48.787078 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:48.787085 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:48.787097 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:48.787116 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:48.787158 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:48.787173 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:48.787331 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:48.787415 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 07:03:48.787519 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":414,"threads_started":1}
I20260811 07:03:48.789614 10127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:48.873672 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 9983
I20260811 07:03:48.896387 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 10136
I20260811 07:03:48.900731 10303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:48.897420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51944 (local address 127.30.73.67:40001)
0811 07:03:48.898111 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:48.898119 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:48.898150 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:03:48.898247 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:48.898257 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:48.898509 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:48.898693 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:48.899914 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:48.899921 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:48.899934 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:03:48.899945 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:48.899986 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:03:48.900000 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:48.900228 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:48.900304 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 07:03:48.900416 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":282,"threads_started":1}
I20260811 07:03:48.902124 10284 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:48.986152 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 10136
I20260811 07:03:49.007546 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 9733
I20260811 07:03:49.008882 9801 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:49.113962 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 9733
2026-08-11T07:03:49Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2532 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:03:49 dist-test-slave-69rg krb5kdc[10309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:03:49 dist-test-slave-69rg krb5kdc[10309](info): set up 2 sockets
Aug 11 07:03:49 dist-test-slave-69rg krb5kdc[10309](info): commencing operation
krb5kdc: starting...
W20260811 07:03:50.374464 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.007s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:03:50 dist-test-slave-69rg krb5kdc[10309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:03:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:03:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:03:50.751173 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:38835
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:46319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:38835
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:51.120519 10324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:51.120862 10324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:51.121047 10324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:51.129101 10324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:03:51.129228 10324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:51.129323 10324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:51.129431 10324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:03:51.129503 10324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:03:51.139889 10324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:46319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:38835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:38835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:51.141352 10324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:51.142797 10324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:51.155613 10333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:51.155676 10330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:51.155685 10329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:51.156836 10324 server_base.cc:1034] running on GCE node
I20260811 07:03:51.157737 10324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:51.159307 10324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:51.160553 10324 hybrid_clock.cc:648] HybridClock initialized: now 1786431831160520 us; error 52 us; skew 500 ppm
I20260811 07:03:51.160938 10324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:51 dist-test-slave-69rg krb5kdc[10309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431831, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:51.169757 10324 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:03:51.171629 10324 webserver.cc:460] Webserver started at http://127.30.73.126:45881/ using document root <none> and password file <none>
I20260811 07:03:51.172452 10324 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:51.172627 10324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:51.172991 10324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:51.176519 10324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "b054a7c04167463a8819ee12d9006224"
format_stamp: "Formatted at 2026-08-11 07:03:51 on dist-test-slave-69rg"
server_key: "1f792949cbd2f8df3379fee97400bcfb"
server_key_iv: "3a96e56a9a40087b530b181265e79d46"
server_key_version: "encryptionkey@0"
I20260811 07:03:51.177399 10324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "b054a7c04167463a8819ee12d9006224"
format_stamp: "Formatted at 2026-08-11 07:03:51 on dist-test-slave-69rg"
server_key: "1f792949cbd2f8df3379fee97400bcfb"
server_key_iv: "3a96e56a9a40087b530b181265e79d46"
server_key_version: "encryptionkey@0"
I20260811 07:03:51.183382 10324 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 07:03:51.187389 10341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:51.189355 10324 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:03:51.189642 10324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "b054a7c04167463a8819ee12d9006224"
format_stamp: "Formatted at 2026-08-11 07:03:51 on dist-test-slave-69rg"
server_key: "1f792949cbd2f8df3379fee97400bcfb"
server_key_iv: "3a96e56a9a40087b530b181265e79d46"
server_key_version: "encryptionkey@0"
I20260811 07:03:51.189951 10324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:51.207747 10324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:51.212383 10324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:51.212788 10324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:51.234483 10324 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:38835
I20260811 07:03:51.234515 10403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:38835 every 8 connection(s)
I20260811 07:03:51.236145 10324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:03:51.239315 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 10324
I20260811 07:03:51.239583 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:03:51.240468 31013 external_mini_cluster.cc:1428] Setting key 35530363e1f8d2f51953d4c35e2a96d1
I20260811 07:03:51.240532 10404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:51.255646 10404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224: Bootstrap starting.
Aug 11 07:03:51 dist-test-slave-69rg krb5kdc[10309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:03:51.259457 10404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:51.260617 10404 log.cc:824] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:51.264375 10404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224: No bootstrap required, opened a new log
I20260811 07:03:51.266676 10407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:51.242862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58446 (local address 127.30.73.126:38835)
0811 07:03:51.243848 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:51.243860 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:51.243908 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:03:51.245660 (+ 1752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:51.245682 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:51.246176 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:51.246526 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:51.248432 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:51.249769 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:51.251702 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:51.252501 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:51.252666 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:51.258083 (+ 5417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:51.258093 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:51.258108 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:51.258155 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:51.262051 (+ 3896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:51.262970 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:51.262978 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:51.262984 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:51.263164 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:51.263653 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:51.263657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:51.263659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:51.264213 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:51.264548 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:51.265037 (+ 489us) server_negotiation.cc:299] Negotiation successful
0811 07:03:51.265519 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":467,"threads_started":1}
I20260811 07:03:51.272696 10404 raft_consensus.cc:348] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b054a7c04167463a8819ee12d9006224" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 38835 } }
I20260811 07:03:51.273068 10404 raft_consensus.cc:374] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:51.273209 10404 raft_consensus.cc:729] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b054a7c04167463a8819ee12d9006224, State: Initialized, Role: FOLLOWER
I20260811 07:03:51.273787 10404 consensus_queue.cc:260] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b054a7c04167463a8819ee12d9006224" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 38835 } }
I20260811 07:03:51.274142 10404 raft_consensus.cc:388] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:03:51.274290 10404 raft_consensus.cc:482] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:03:51.274464 10404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:51.276684 10404 raft_consensus.cc:504] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b054a7c04167463a8819ee12d9006224" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 38835 } }
I20260811 07:03:51.277199 10404 leader_election.cc:302] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b054a7c04167463a8819ee12d9006224; no voters:
I20260811 07:03:51.277909 10404 leader_election.cc:288] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:03:51.278118 10409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:51.279372 10409 raft_consensus.cc:686] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [term 1 LEADER]: Becoming Leader. State: Replica: b054a7c04167463a8819ee12d9006224, State: Running, Role: LEADER
I20260811 07:03:51.280066 10409 consensus_queue.cc:237] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b054a7c04167463a8819ee12d9006224" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 38835 } }
I20260811 07:03:51.280196 10404 sys_catalog.cc:564] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:03:51.283547 10410 sys_catalog.cc:455] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b054a7c04167463a8819ee12d9006224" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b054a7c04167463a8819ee12d9006224" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 38835 } } }
I20260811 07:03:51.283845 10411 sys_catalog.cc:455] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b054a7c04167463a8819ee12d9006224. Latest consensus state: current_term: 1 leader_uuid: "b054a7c04167463a8819ee12d9006224" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b054a7c04167463a8819ee12d9006224" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 38835 } } }
I20260811 07:03:51.284262 10411 sys_catalog.cc:458] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:51.284143 10410 sys_catalog.cc:458] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224 [sys.catalog]: This master's current role is: LEADER
I20260811 07:03:51.291096 10418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:03:51.298689 10418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:03:51.309288 10418 catalog_manager.cc:1347] Generated new cluster ID: 333e87f0c3c2415e9b2bed2fc246b3b4
I20260811 07:03:51.309437 10418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:03:51.353003 10418 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:03:51.354449 10418 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:03:51.366004 10418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224: Generated new TSK 0
I20260811 07:03:51.366915 10418 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:03:51.454609 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:38835
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:46319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:51.816159 10433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:51.816510 10433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:51.816690 10433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:51.824146 10433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:51.824321 10433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:51.824517 10433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:03:51.834743 10433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:46319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:38835
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:51.836242 10433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:51.837718 10433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:51.851802 10440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:51.851933 10439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:51.851933 10442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:51.852787 10433 server_base.cc:1034] running on GCE node
I20260811 07:03:51.853435 10433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:51.854542 10433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:51.855801 10433 hybrid_clock.cc:648] HybridClock initialized: now 1786431831855755 us; error 40 us; skew 500 ppm
I20260811 07:03:51.856129 10433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:51 dist-test-slave-69rg krb5kdc[10309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431831, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:51.859522 10433 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:03:51.861265 10433 webserver.cc:460] Webserver started at http://127.30.73.65:41369/ using document root <none> and password file <none>
I20260811 07:03:51.862102 10433 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:51.862293 10433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:51.862627 10433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:51.866587 10433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "f307f46adf3d4516ac3367e64a18dffb"
format_stamp: "Formatted at 2026-08-11 07:03:51 on dist-test-slave-69rg"
server_key: "da039bb219f918b29cea4ba4ab1c3c8b"
server_key_iv: "bc8b0b0351df66958b776cc42b71490e"
server_key_version: "encryptionkey@0"
I20260811 07:03:51.867429 10433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "f307f46adf3d4516ac3367e64a18dffb"
format_stamp: "Formatted at 2026-08-11 07:03:51 on dist-test-slave-69rg"
server_key: "da039bb219f918b29cea4ba4ab1c3c8b"
server_key_iv: "bc8b0b0351df66958b776cc42b71490e"
server_key_version: "encryptionkey@0"
I20260811 07:03:51.872893 10433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:03:51.876530 10449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:51.877866 10433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:03:51.878054 10433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "f307f46adf3d4516ac3367e64a18dffb"
format_stamp: "Formatted at 2026-08-11 07:03:51 on dist-test-slave-69rg"
server_key: "da039bb219f918b29cea4ba4ab1c3c8b"
server_key_iv: "bc8b0b0351df66958b776cc42b71490e"
server_key_version: "encryptionkey@0"
I20260811 07:03:51.878288 10433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:51.890929 10433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:51.895630 10433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:51.895965 10433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:51.896963 10433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:51.898428 10433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:51.898505 10433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:51.898669 10433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:51.898737 10433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:51.933656 10433 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:35837
I20260811 07:03:51.933746 10578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:35837 every 8 connection(s)
I20260811 07:03:51.935222 10433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:03:51.937124 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 10433
I20260811 07:03:51.937433 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:03:51.938391 31013 external_mini_cluster.cc:1428] Setting key f029b19833d33298b6c0618e813616a1
Aug 11 07:03:51 dist-test-slave-69rg krb5kdc[10309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431831, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:03:51.960330 10581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:51.938152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:55225 (local address 127.30.73.126:38835)
0811 07:03:51.938989 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:51.939000 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:51.939828 (+ 828us) server_negotiation.cc:407] Connection header received
0811 07:03:51.942717 (+ 2889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:51.942722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:51.942796 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:51.942902 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:51.945255 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:51.946123 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:51.948907 (+ 2784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:51.949334 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:51.949450 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:51.954241 (+ 4791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:51.954247 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:51.954250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:51.954286 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:51.956850 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:51.957597 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:51.957603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:51.957607 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:51.957763 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:51.958242 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:51.958248 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:51.958251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:51.958756 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:51.958929 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:51.959688 (+ 759us) server_negotiation.cc:299] Negotiation successful
0811 07:03:51.959932 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":529,"threads_started":1}
I20260811 07:03:51.961328 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:51.938580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:38835 (local address 127.30.73.65:55225)
0811 07:03:51.939658 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:51.939714 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:51.942367 (+ 2653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:51.943219 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:51.943234 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:51.944134 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:51.945027 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:51.945056 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:51.946286 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:51.946295 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:51.948704 (+ 2409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:51.948724 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:51.949603 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:51.949614 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:51.950014 (+ 400us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:51.950876 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:51.950915 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:51.954002 (+ 3087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:51.957002 (+ 3000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:51.957012 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:51.957028 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:51.957472 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:51.957908 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:51.957913 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:51.957917 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:51.958123 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:51.958916 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:51.958925 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:51.959291 (+ 366us) client_negotiation.cc:769] Sending connection context
0811 07:03:51.959575 (+ 284us) client_negotiation.cc:240] Negotiation successful
0811 07:03:51.960139 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"thread_start_us":515,"threads_started":1}
I20260811 07:03:51.963002 10579 heartbeater.cc:347] Connected to a master server at 127.30.73.126:38835
I20260811 07:03:51.963354 10579 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:51.964147 10579 heartbeater.cc:511] Master 127.30.73.126:38835 requested a full tablet report, sending...
I20260811 07:03:51.966367 10360 ts_manager.cc:194] Registered new tserver with Master: f307f46adf3d4516ac3367e64a18dffb (127.30.73.65:35837)
I20260811 07:03:51.967824 10360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:55225
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:03:52.006425 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:38835
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:46319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:52.384509 10586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:52.384825 10586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:52.384923 10586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:52.392540 10586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:52.392668 10586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:52.392783 10586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:03:52.403260 10586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:46319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:38835
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:52.404572 10586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:52.405840 10586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:52.419675 10592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:52.419835 10591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:52.419818 10594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:52.421119 10586 server_base.cc:1034] running on GCE node
I20260811 07:03:52.421939 10586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:52.423061 10586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:52.424330 10586 hybrid_clock.cc:648] HybridClock initialized: now 1786431832424276 us; error 49 us; skew 500 ppm
I20260811 07:03:52.424680 10586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:52 dist-test-slave-69rg krb5kdc[10309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431832, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:52.428328 10586 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:03:52.430104 10586 webserver.cc:460] Webserver started at http://127.30.73.66:33579/ using document root <none> and password file <none>
I20260811 07:03:52.430891 10586 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:52.431072 10586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:52.431447 10586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:52.435086 10586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "19d70d3c4cb64128b7835b127acfe92c"
format_stamp: "Formatted at 2026-08-11 07:03:52 on dist-test-slave-69rg"
server_key: "3f1db5bfe5071c79d89fef2d9b184f2d"
server_key_iv: "16496af5d794a1426d2803da37f20b06"
server_key_version: "encryptionkey@0"
I20260811 07:03:52.436010 10586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "19d70d3c4cb64128b7835b127acfe92c"
format_stamp: "Formatted at 2026-08-11 07:03:52 on dist-test-slave-69rg"
server_key: "3f1db5bfe5071c79d89fef2d9b184f2d"
server_key_iv: "16496af5d794a1426d2803da37f20b06"
server_key_version: "encryptionkey@0"
I20260811 07:03:52.442268 10586 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 07:03:52.445976 10603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:52.447573 10586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:03:52.447774 10586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "19d70d3c4cb64128b7835b127acfe92c"
format_stamp: "Formatted at 2026-08-11 07:03:52 on dist-test-slave-69rg"
server_key: "3f1db5bfe5071c79d89fef2d9b184f2d"
server_key_iv: "16496af5d794a1426d2803da37f20b06"
server_key_version: "encryptionkey@0"
I20260811 07:03:52.448000 10586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:52.467428 10586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:52.472110 10586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:52.472458 10586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:52.473489 10586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:52.474933 10586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:52.475055 10586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:52.475225 10586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:52.475306 10586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:52.510470 10586 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:41387
I20260811 07:03:52.510504 10733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:41387 every 8 connection(s)
I20260811 07:03:52.511807 10586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:03:52.519057 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 10586
I20260811 07:03:52.519290 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:03:52.519739 31013 external_mini_cluster.cc:1428] Setting key 15379f95cf2d3653f2b5c507b1326507
Aug 11 07:03:52 dist-test-slave-69rg krb5kdc[10309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431832, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:03:52.535420 10736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:52.514949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:39675 (local address 127.30.73.126:38835)
0811 07:03:52.515473 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:52.515479 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:52.516557 (+ 1078us) server_negotiation.cc:407] Connection header received
0811 07:03:52.518644 (+ 2087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:52.518651 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:52.518762 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:52.518901 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:52.520637 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:52.521478 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:52.523343 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:52.524141 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:52.524302 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:52.528161 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:52.528170 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:52.528177 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:52.528222 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:52.532010 (+ 3788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:52.532787 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:52.532795 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:52.532801 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:52.532970 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:52.533419 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:52.533426 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:52.533432 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:52.533847 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:52.533982 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:52.534952 (+ 970us) server_negotiation.cc:299] Negotiation successful
0811 07:03:52.535134 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":271,"threads_started":1}
I20260811 07:03:52.536947 10737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:52.515500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:38835 (local address 127.30.73.66:39675)
0811 07:03:52.516304 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:52.516345 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:52.518326 (+ 1981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:52.519160 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:52.519168 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:52.519819 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:52.520461 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:52.520480 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:52.521679 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:52.521684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:52.523180 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:52.523193 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:52.524390 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:52.524395 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:52.524603 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:52.525332 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:52.525360 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:52.527912 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:52.532170 (+ 4258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:52.532177 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:52.532197 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:52.532641 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:52.533088 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:52.533091 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:52.533093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:52.533289 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:52.534007 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:52.534016 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:52.534537 (+ 521us) client_negotiation.cc:769] Sending connection context
0811 07:03:52.534872 (+ 335us) client_negotiation.cc:240] Negotiation successful
0811 07:03:52.535493 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":319,"threads_started":1}
I20260811 07:03:52.538606 10734 heartbeater.cc:347] Connected to a master server at 127.30.73.126:38835
I20260811 07:03:52.538967 10734 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:52.539776 10734 heartbeater.cc:511] Master 127.30.73.126:38835 requested a full tablet report, sending...
I20260811 07:03:52.541303 10360 ts_manager.cc:194] Registered new tserver with Master: 19d70d3c4cb64128b7835b127acfe92c (127.30.73.66:41387)
I20260811 07:03:52.542230 10360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:39675
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:03:52.590211 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:38835
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:46319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:03:52.932512 10740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:03:52.932838 10740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:03:52.933010 10740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:03:52.940757 10740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:03:52.940877 10740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:03:52.941063 10740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:03:52.951402 10740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:46319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:38835
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:03:52.952876 10740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:03:52.954445 10740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:03:52.967893 10746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:52.967835 10748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:03:52.967875 10745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:03:52.969110 10740 server_base.cc:1034] running on GCE node
I20260811 07:03:52.969732 10740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:03:52.970803 10740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:03:52.970865 10579 heartbeater.cc:503] Master 127.30.73.126:38835 was elected leader, sending a full tablet report...
I20260811 07:03:52.972060 10740 hybrid_clock.cc:648] HybridClock initialized: now 1786431832971992 us; error 55 us; skew 500 ppm
I20260811 07:03:52.972441 10740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:03:52 dist-test-slave-69rg krb5kdc[10309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431832, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:03:52.975898 10740 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:03:52.977560 10740 webserver.cc:460] Webserver started at http://127.30.73.67:33239/ using document root <none> and password file <none>
I20260811 07:03:52.978377 10740 fs_manager.cc:359] Metadata directory not provided
I20260811 07:03:52.978521 10740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:03:52.978855 10740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:03:52.982048 10740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "4a4964522193475cacfad34e1e6049b4"
format_stamp: "Formatted at 2026-08-11 07:03:52 on dist-test-slave-69rg"
server_key: "7756e242e339e4263886da453c4b94f6"
server_key_iv: "c24852ee19e9ba8d43d85020dbf9b70d"
server_key_version: "encryptionkey@0"
I20260811 07:03:52.982925 10740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "4a4964522193475cacfad34e1e6049b4"
format_stamp: "Formatted at 2026-08-11 07:03:52 on dist-test-slave-69rg"
server_key: "7756e242e339e4263886da453c4b94f6"
server_key_iv: "c24852ee19e9ba8d43d85020dbf9b70d"
server_key_version: "encryptionkey@0"
I20260811 07:03:52.988416 10740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:03:52.991931 10755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:52.993320 10740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:03:52.993515 10740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "4a4964522193475cacfad34e1e6049b4"
format_stamp: "Formatted at 2026-08-11 07:03:52 on dist-test-slave-69rg"
server_key: "7756e242e339e4263886da453c4b94f6"
server_key_iv: "c24852ee19e9ba8d43d85020dbf9b70d"
server_key_version: "encryptionkey@0"
I20260811 07:03:52.993734 10740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:03:53.010557 10740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:03:53.015650 10740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:03:53.015990 10740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:03:53.017076 10740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:03:53.018633 10740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:03:53.018764 10740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:53.018924 10740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:03:53.019008 10740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:03:53.057278 10740 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:46739
I20260811 07:03:53.057343 10883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:46739 every 8 connection(s)
I20260811 07:03:53.058733 10740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:03:53.060406 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 10740
I20260811 07:03:53.060621 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:03:53.061066 31013 external_mini_cluster.cc:1428] Setting key 5d7cc868c913ce0c12acf06f1661bedc
Aug 11 07:03:53 dist-test-slave-69rg krb5kdc[10309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431832, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:03:53.081108 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.061489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:39755 (local address 127.30.73.126:38835)
0811 07:03:53.062022 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.062026 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.063238 (+ 1212us) server_negotiation.cc:407] Connection header received
0811 07:03:53.065388 (+ 2150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.065393 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.065472 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.065570 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:53.067100 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.067885 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.069434 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.069872 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.070020 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.073613 (+ 3593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:53.073618 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:53.073621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:53.073660 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:53.077487 (+ 3827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.078523 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.078527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.078529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.078678 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.079179 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.079183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.079185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.079506 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:53.079647 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.080568 (+ 921us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.080770 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":293,"threads_started":1}
I20260811 07:03:53.082386 10887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.062118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:38835 (local address 127.30.73.67:39755)
0811 07:03:53.062999 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:53.063079 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:53.065093 (+ 2014us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:53.065784 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:53.065792 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:53.066396 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:03:53.066930 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.066946 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.068039 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.068044 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.069276 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.069288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.070161 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.070167 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.070370 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.071146 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:03:53.071168 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:03:53.073368 (+ 2200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:03:53.077681 (+ 4313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:53.077689 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:53.077704 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:53.078360 (+ 656us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:53.078794 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:03:53.078798 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:03:53.078800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:03:53.079000 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:03:53.079701 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:03:53.079709 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:03:53.080164 (+ 455us) client_negotiation.cc:769] Sending connection context
0811 07:03:53.080410 (+ 246us) client_negotiation.cc:240] Negotiation successful
0811 07:03:53.080896 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":436,"threads_started":1}
I20260811 07:03:53.084033 10884 heartbeater.cc:347] Connected to a master server at 127.30.73.126:38835
I20260811 07:03:53.084388 10884 heartbeater.cc:464] Registering TS with master...
I20260811 07:03:53.085208 10884 heartbeater.cc:511] Master 127.30.73.126:38835 requested a full tablet report, sending...
I20260811 07:03:53.086938 10360 ts_manager.cc:194] Registered new tserver with Master: 4a4964522193475cacfad34e1e6049b4 (127.30.73.67:46739)
I20260811 07:03:53.087934 10360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:39755
I20260811 07:03:53.090044 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:03:53.107999 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.094713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58460 (local address 127.30.73.126:38835)
0811 07:03:53.094893 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.094897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.095529 (+ 632us) server_negotiation.cc:407] Connection header received
0811 07:03:53.095773 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.095778 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.095894 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.095994 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:53.097528 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.098447 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.099721 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.100155 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.100305 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.102656 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:53.102663 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:53.102669 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:53.102706 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:53.105198 (+ 2492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.105886 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.105892 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.105897 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.106037 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.106440 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.106445 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.106448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.106790 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:53.107060 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.107421 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.107657 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:03:53.112613 10359 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:03:53.119735 10359 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:03:53.145617 10903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.132645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56304 (local address 127.30.73.66:41387)
0811 07:03:53.133573 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.133582 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.134216 (+ 634us) server_negotiation.cc:407] Connection header received
0811 07:03:53.134587 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.134598 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.134860 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.135025 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:53.136181 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.138231 (+ 2050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.141962 (+ 3731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.143989 (+ 2027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.144134 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.144362 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.145083 (+ 721us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.145269 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":650,"threads_started":1}
I20260811 07:03:53.146901 10901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.132328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:41387 (local address 127.0.0.1:56304)
0811 07:03:53.134059 (+ 1731us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:53.134101 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:53.134324 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:53.135376 (+ 1052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:53.135387 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:53.135430 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:53.135925 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.135940 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.138481 (+ 2541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.138489 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.141696 (+ 3207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.141719 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.144559 (+ 2840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.144579 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.144800 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.144852 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 07:03:53.146208 (+ 1356us) client_negotiation.cc:240] Negotiation successful
0811 07:03:53.146453 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1434,"spinlock_wait_cycles":1280,"thread_start_us":1269,"threads_started":1}
I20260811 07:03:53.150919 10655 tablet_service.cc:1467] Processing CreateTablet for tablet ed9d5b16216143ca965c01deb82852df (DEFAULT_TABLE table=test-table [id=f97e09e090004f6caedc78a91a058db3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:53.152592 10655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed9d5b16216143ca965c01deb82852df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:53.153039 10904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.133069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:46739 (local address 127.0.0.1:50130)
0811 07:03:53.134143 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:53.134163 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:53.134324 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:53.145653 (+ 11329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:53.145660 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:53.145692 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:53.146228 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.146243 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.148544 (+ 2301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.148550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.150690 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.150705 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.152256 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.152262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.152435 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.152468 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:03:53.152568 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:03:53.152719 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":942,"thread_start_us":987,"threads_started":1}
I20260811 07:03:53.153163 10905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.133762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50130 (local address 127.30.73.67:46739)
0811 07:03:53.144963 (+ 11201us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.144972 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.145020 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:03:53.145148 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.145156 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.145408 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.146457 (+ 1049us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:53.146762 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.148381 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.150893 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.151998 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.152254 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.152489 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.152630 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.152802 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11015,"thread_start_us":12031,"threads_started":1}
I20260811 07:03:53.154667 10907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.135009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44798 (local address 127.30.73.65:35837)
0811 07:03:53.144673 (+ 9664us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.144682 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.146685 (+ 2003us) server_negotiation.cc:407] Connection header received
0811 07:03:53.146916 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.146921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.147164 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.147391 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:53.147968 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.149507 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.151998 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.153525 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.153667 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.153938 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.154193 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.154351 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9432,"thread_start_us":9226,"threads_started":1}
I20260811 07:03:53.154692 10906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.134463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35837 (local address 127.0.0.1:44798)
0811 07:03:53.146544 (+ 12081us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:53.146560 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:53.146729 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:53.147414 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:53.147419 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:53.147445 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:53.147756 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.147768 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.149678 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.149683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.151817 (+ 2134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.151834 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.153792 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.153798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.154005 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.154029 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:03:53.154142 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 07:03:53.154264 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11967,"mutex_wait_us":5,"thread_start_us":11794,"threads_started":1}
I20260811 07:03:53.157164 10807 tablet_service.cc:1467] Processing CreateTablet for tablet ed9d5b16216143ca965c01deb82852df (DEFAULT_TABLE table=test-table [id=f97e09e090004f6caedc78a91a058db3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:53.158411 10807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed9d5b16216143ca965c01deb82852df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:53.162930 10502 tablet_service.cc:1467] Processing CreateTablet for tablet ed9d5b16216143ca965c01deb82852df (DEFAULT_TABLE table=test-table [id=f97e09e090004f6caedc78a91a058db3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:03:53.164412 10502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed9d5b16216143ca965c01deb82852df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:03:53.165861 10908 tablet_bootstrap.cc:492] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: Bootstrap starting.
I20260811 07:03:53.169008 10908 tablet_bootstrap.cc:654] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:53.170135 10908 log.cc:824] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:53.172912 10910 tablet_bootstrap.cc:492] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: Bootstrap starting.
I20260811 07:03:53.174263 10908 tablet_bootstrap.cc:492] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: No bootstrap required, opened a new log
I20260811 07:03:53.174563 10908 ts_tablet_manager.cc:1397] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260811 07:03:53.176683 10910 tablet_bootstrap.cc:654] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:53.177939 10911 tablet_bootstrap.cc:492] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: Bootstrap starting.
I20260811 07:03:53.177975 10910 log.cc:824] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:53.181219 10911 tablet_bootstrap.cc:654] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: Neither blocks nor log segments found. Creating new log.
I20260811 07:03:53.181439 10910 tablet_bootstrap.cc:492] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: No bootstrap required, opened a new log
I20260811 07:03:53.181780 10910 ts_tablet_manager.cc:1397] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 07:03:53.182456 10911 log.cc:824] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: Log is configured to *not* fsync() on all Append() calls
I20260811 07:03:53.185727 10908 raft_consensus.cc:348] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } }
I20260811 07:03:53.186245 10908 raft_consensus.cc:374] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:53.186349 10908 raft_consensus.cc:729] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19d70d3c4cb64128b7835b127acfe92c, State: Initialized, Role: FOLLOWER
I20260811 07:03:53.186964 10908 consensus_queue.cc:260] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } }
I20260811 07:03:53.188265 10734 heartbeater.cc:503] Master 127.30.73.126:38835 was elected leader, sending a full tablet report...
I20260811 07:03:53.188814 10908 ts_tablet_manager.cc:1428] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: Time spent starting tablet: real 0.014s user 0.012s sys 0.002s
I20260811 07:03:53.191622 10911 tablet_bootstrap.cc:492] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: No bootstrap required, opened a new log
I20260811 07:03:53.191955 10911 ts_tablet_manager.cc:1397] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20260811 07:03:53.193548 10910 raft_consensus.cc:348] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } }
I20260811 07:03:53.194029 10910 raft_consensus.cc:374] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:53.194141 10910 raft_consensus.cc:729] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a4964522193475cacfad34e1e6049b4, State: Initialized, Role: FOLLOWER
I20260811 07:03:53.194864 10910 consensus_queue.cc:260] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } }
I20260811 07:03:53.196087 10884 heartbeater.cc:503] Master 127.30.73.126:38835 was elected leader, sending a full tablet report...
I20260811 07:03:53.196653 10910 ts_tablet_manager.cc:1428] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: Time spent starting tablet: real 0.015s user 0.006s sys 0.007s
I20260811 07:03:53.201777 10911 raft_consensus.cc:348] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } }
I20260811 07:03:53.202227 10911 raft_consensus.cc:374] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:03:53.202338 10911 raft_consensus.cc:729] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f307f46adf3d4516ac3367e64a18dffb, State: Initialized, Role: FOLLOWER
I20260811 07:03:53.202872 10911 consensus_queue.cc:260] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } }
I20260811 07:03:53.204262 10911 ts_tablet_manager.cc:1428] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
W20260811 07:03:53.263990 10735 tablet.cc:2369] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:03:53.310662 10885 tablet.cc:2369] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:03:53.438236 10580 tablet.cc:2369] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:03:53.447870 10917 raft_consensus.cc:482] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:03:53.448210 10917 raft_consensus.cc:504] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } }
I20260811 07:03:53.450014 10917 leader_election.cc:288] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19d70d3c4cb64128b7835b127acfe92c (127.30.73.66:41387), 4a4964522193475cacfad34e1e6049b4 (127.30.73.67:46739)
I20260811 07:03:53.458679 10905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.450595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:46037 (local address 127.30.73.67:46739)
0811 07:03:53.450821 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.450831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.451487 (+ 656us) server_negotiation.cc:407] Connection header received
0811 07:03:53.451615 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.451621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.451705 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.451806 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:53.452888 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.454090 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.456850 (+ 2760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.457625 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.457803 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.457910 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.458267 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.458410 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:03:53.458751 10903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.450591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:41327 (local address 127.30.73.66:41387)
0811 07:03:53.450836 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.450842 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.451384 (+ 542us) server_negotiation.cc:407] Connection header received
0811 07:03:53.451616 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.451621 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.451705 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.451805 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:03:53.452888 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.454087 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.456879 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.457655 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.457886 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.457962 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.458350 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.458496 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:03:53.458901 10918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.450402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:46739 (local address 127.30.73.65:46037)
0811 07:03:53.451360 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:53.451375 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:53.451482 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:53.451856 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:53.451861 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:53.451905 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:53.452665 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.452680 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.454252 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.454257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.456663 (+ 2406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.456691 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.457882 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.457889 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.458093 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.458118 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:03:53.458200 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:03:53.458346 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"mutex_wait_us":282,"spinlock_wait_cycles":4864,"thread_start_us":415,"threads_started":1}
I20260811 07:03:53.458922 10919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.450310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:41387 (local address 127.30.73.65:41327)
0811 07:03:53.451262 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0811 07:03:53.451284 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:03:53.451473 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:03:53.451856 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:03:53.451861 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:03:53.451898 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:03:53.452667 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.452680 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.454251 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.454257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.456707 (+ 2450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:03:53.456724 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.457969 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.457976 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:03:53.458133 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.458156 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 07:03:53.458290 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 07:03:53.458416 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"mutex_wait_us":167,"spinlock_wait_cycles":99968,"thread_start_us":708,"threads_started":1}
I20260811 07:03:53.460129 10680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed9d5b16216143ca965c01deb82852df" candidate_uuid: "f307f46adf3d4516ac3367e64a18dffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19d70d3c4cb64128b7835b127acfe92c" is_pre_election: true
I20260811 07:03:53.460179 10831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed9d5b16216143ca965c01deb82852df" candidate_uuid: "f307f46adf3d4516ac3367e64a18dffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a4964522193475cacfad34e1e6049b4" is_pre_election: true
I20260811 07:03:53.460649 10680 raft_consensus.cc:2454] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f307f46adf3d4516ac3367e64a18dffb in term 0.
I20260811 07:03:53.460697 10831 raft_consensus.cc:2454] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f307f46adf3d4516ac3367e64a18dffb in term 0.
I20260811 07:03:53.461385 10451 leader_election.cc:302] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a4964522193475cacfad34e1e6049b4, f307f46adf3d4516ac3367e64a18dffb; no voters:
I20260811 07:03:53.461860 10917 raft_consensus.cc:2781] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:03:53.462028 10917 raft_consensus.cc:482] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:03:53.462149 10917 raft_consensus.cc:3037] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:53.464399 10917 raft_consensus.cc:504] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } }
I20260811 07:03:53.465085 10917 leader_election.cc:288] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [CANDIDATE]: Term 1 election: Requested vote from peers 19d70d3c4cb64128b7835b127acfe92c (127.30.73.66:41387), 4a4964522193475cacfad34e1e6049b4 (127.30.73.67:46739)
I20260811 07:03:53.465524 10680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed9d5b16216143ca965c01deb82852df" candidate_uuid: "f307f46adf3d4516ac3367e64a18dffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19d70d3c4cb64128b7835b127acfe92c"
I20260811 07:03:53.465682 10831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed9d5b16216143ca965c01deb82852df" candidate_uuid: "f307f46adf3d4516ac3367e64a18dffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a4964522193475cacfad34e1e6049b4"
I20260811 07:03:53.465750 10680 raft_consensus.cc:3037] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:53.465931 10831 raft_consensus.cc:3037] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:03:53.468058 10680 raft_consensus.cc:2454] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f307f46adf3d4516ac3367e64a18dffb in term 1.
I20260811 07:03:53.468137 10831 raft_consensus.cc:2454] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f307f46adf3d4516ac3367e64a18dffb in term 1.
I20260811 07:03:53.468559 10452 leader_election.cc:302] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 19d70d3c4cb64128b7835b127acfe92c, 4a4964522193475cacfad34e1e6049b4, f307f46adf3d4516ac3367e64a18dffb; no voters:
I20260811 07:03:53.469000 10917 raft_consensus.cc:2781] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:03:53.469503 10917 raft_consensus.cc:686] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 1 LEADER]: Becoming Leader. State: Replica: f307f46adf3d4516ac3367e64a18dffb, State: Running, Role: LEADER
I20260811 07:03:53.470090 10917 consensus_queue.cc:237] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } }
I20260811 07:03:53.475162 10359 catalog_manager.cc:5495] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb reported cstate change: term changed from 0 to 1, leader changed from <none> to f307f46adf3d4516ac3367e64a18dffb (127.30.73.65). New cstate: current_term: 1 leader_uuid: "f307f46adf3d4516ac3367e64a18dffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f307f46adf3d4516ac3367e64a18dffb" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 } health_report { overall_health: UNKNOWN } } }
I20260811 07:03:53.512187 10907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.506347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44806 (local address 127.30.73.65:35837)
0811 07:03:53.506553 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.506558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.506578 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:03:53.506679 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.506682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.506760 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.506889 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:03:53.507296 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.508019 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.509433 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.510088 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.510290 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.510786 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:03:53.511467 (+ 681us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:03:53.511640 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.511795 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.511897 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:03:53.521669 10831 raft_consensus.cc:1261] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [term 1 FOLLOWER]: Refusing update from remote peer f307f46adf3d4516ac3367e64a18dffb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:53.522099 10680 raft_consensus.cc:1261] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [term 1 FOLLOWER]: Refusing update from remote peer f307f46adf3d4516ac3367e64a18dffb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:03:53.522862 10917 consensus_queue.cc:1035] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a4964522193475cacfad34e1e6049b4" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:53.523247 10920 consensus_queue.cc:1035] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "19d70d3c4cb64128b7835b127acfe92c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:03:53.535574 10923 mvcc.cc:205] Tried to move back new op lower bound from 7317224790092525568 to 7317224789897351168. Current Snapshot: MvccSnapshot[applied={T|T < 7317224790092525568}]
I20260811 07:03:53.550081 10359 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:53.550359 10359 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:03:53.554359 10359 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b054a7c04167463a8819ee12d9006224: Sending DeleteTablet for 3 replicas of tablet ed9d5b16216143ca965c01deb82852df
I20260811 07:03:53.555526 10655 tablet_service.cc:1514] Processing DeleteTablet for tablet ed9d5b16216143ca965c01deb82852df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:53 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:56304
I20260811 07:03:53.555684 10502 tablet_service.cc:1514] Processing DeleteTablet for tablet ed9d5b16216143ca965c01deb82852df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:53 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:44798
I20260811 07:03:53.556027 10807 tablet_service.cc:1514] Processing DeleteTablet for tablet ed9d5b16216143ca965c01deb82852df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:03:53 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:50130
I20260811 07:03:53.558085 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 10433
I20260811 07:03:53.566507 10935 tablet_replica.cc:330] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: stopping tablet replica
I20260811 07:03:53.567129 10935 raft_consensus.cc:2229] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:53.567790 10935 raft_consensus.cc:2258] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:53.568389 10936 tablet_replica.cc:330] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: stopping tablet replica
I20260811 07:03:53.568986 10937 tablet_replica.cc:330] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: stopping tablet replica
I20260811 07:03:53.569514 10936 raft_consensus.cc:2229] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:03:53.570346 10936 raft_consensus.cc:2258] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:53.571738 10935 ts_tablet_manager.cc:1905] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:53.569638 10937 raft_consensus.cc:2229] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:03:53.572420 10937 raft_consensus.cc:2258] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:03:53.572539 10936 ts_tablet_manager.cc:1905] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 07:03:53 dist-test-slave-69rg krb5kdc[10309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:03:53.579319 10937 ts_tablet_manager.cc:1905] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:03:53.581180 10936 ts_tablet_manager.cc:1918] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:53.581449 10936 log.cc:1196] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/ed9d5b16216143ca965c01deb82852df
I20260811 07:03:53.582222 10936 ts_tablet_manager.cc:1939] T ed9d5b16216143ca965c01deb82852df P f307f46adf3d4516ac3367e64a18dffb: Deleting consensus metadata
I20260811 07:03:53.584468 10344 catalog_manager.cc:4841] TS f307f46adf3d4516ac3367e64a18dffb (127.30.73.65:35837): tablet ed9d5b16216143ca965c01deb82852df (table test-table [id=f97e09e090004f6caedc78a91a058db3]) successfully deleted
I20260811 07:03:53.586335 10935 ts_tablet_manager.cc:1918] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:53.586644 10935 log.cc:1196] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/ed9d5b16216143ca965c01deb82852df
I20260811 07:03:53.587301 10935 ts_tablet_manager.cc:1939] T ed9d5b16216143ca965c01deb82852df P 19d70d3c4cb64128b7835b127acfe92c: Deleting consensus metadata
I20260811 07:03:53.588537 10907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.560052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44814 (local address 127.30.73.65:35837)
0811 07:03:53.560300 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.560309 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.562594 (+ 2285us) server_negotiation.cc:407] Connection header received
0811 07:03:53.562688 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.562696 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.562807 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.562939 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:53.570101 (+ 7162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.571415 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.573279 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.574033 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.574144 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.579986 (+ 5842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:53.580002 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:53.580021 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:53.580089 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:53.584700 (+ 4611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.585734 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.585745 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.585752 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.585984 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.586489 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.586496 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.586499 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.586946 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:53.587252 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.587912 (+ 660us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.588166 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:03:53.589049 10937 ts_tablet_manager.cc:1918] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:03:53.589267 10937 log.cc:1196] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/ed9d5b16216143ca965c01deb82852df
I20260811 07:03:53.589843 10937 ts_tablet_manager.cc:1939] T ed9d5b16216143ca965c01deb82852df P 4a4964522193475cacfad34e1e6049b4: Deleting consensus metadata
I20260811 07:03:53.590351 10570 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:53.591564 10343 catalog_manager.cc:4841] TS 4a4964522193475cacfad34e1e6049b4 (127.30.73.67:46739): tablet ed9d5b16216143ca965c01deb82852df (table test-table [id=f97e09e090004f6caedc78a91a058db3]) successfully deleted
I20260811 07:03:53.591778 10344 catalog_manager.cc:4841] TS 19d70d3c4cb64128b7835b127acfe92c (127.30.73.66:41387): tablet ed9d5b16216143ca965c01deb82852df (table test-table [id=f97e09e090004f6caedc78a91a058db3]) successfully deleted
I20260811 07:03:53.692194 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 10433
I20260811 07:03:53.715004 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 10586
Aug 11 07:03:53 dist-test-slave-69rg krb5kdc[10309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:03:53.730633 10903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.715920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56320 (local address 127.30.73.66:41387)
0811 07:03:53.716142 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.716198 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.716221 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:03:53.716300 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.716304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.716366 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.716485 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:53.717752 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.718573 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.719844 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.720278 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.720424 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.724803 (+ 4379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:53.724819 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:53.724837 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:53.724876 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:53.727936 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.728630 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.728637 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.728639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.728779 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.729123 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.729126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.729128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.729522 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:53.729757 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.730181 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.730353 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 07:03:53.731383 10727 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:53.827117 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 10586
I20260811 07:03:53.850674 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 10740
Aug 11 07:03:53 dist-test-slave-69rg krb5kdc[10309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:03:53.867914 10905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:03:53.851629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50134 (local address 127.30.73.67:46739)
0811 07:03:53.851957 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0811 07:03:53.851963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:03:53.851987 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:03:53.852134 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:03:53.852144 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:03:53.852216 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:03:53.852347 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:03:53.853730 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.854526 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.856049 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:03:53.856494 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:03:53.856666 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:03:53.861943 (+ 5277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:03:53.861963 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:03:53.861981 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:03:53.862021 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:03:53.864788 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.865559 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.865569 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.865573 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.865733 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:03:53.866259 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:03:53.866266 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:03:53.866269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:03:53.866672 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:03:53.866998 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0811 07:03:53.867338 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 07:03:53.867574 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
I20260811 07:03:53.868631 10879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:53.961809 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 10740
I20260811 07:03:53.984066 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 10324
I20260811 07:03:53.985215 10398 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:03:54.100368 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 10324
2026-08-11T07:03:54Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4988 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:03:54 dist-test-slave-69rg krb5kdc[10948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:03:54 dist-test-slave-69rg krb5kdc[10948](info): set up 2 sockets
Aug 11 07:03:54 dist-test-slave-69rg krb5kdc[10948](info): commencing operation
krb5kdc: starting...
W20260811 07:03:55.339502 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:03:55 dist-test-slave-69rg krb5kdc[10948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:03:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:03:55Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.73.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.73.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/rangeradmin_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/rangeradmin_127.30.73.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.73.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.73.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/rangerlookup_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/rangerlookup_127.30.73.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.73.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.73.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/HTTP_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/HTTP_127.30.73.84@KRBTEST.COM.keytab.
I20260811 07:03:55.769690 31013 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskgm9MY0/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/postgres -l logfile start
2026-08-11 07:03:58.680 UTC [10981] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 07:03:58.681 UTC [10981] LOG: listening on IPv4 address "127.30.73.84", port 41471
2026-08-11 07:03:58.685 UTC [10981] LOG: listening on Unix socket "/tmp/.s.PGSQL.41471"
2026-08-11 07:03:58.717 UTC [10983] LOG: database system was shut down at 2026-08-11 07:03:56 UTC
2026-08-11 07:03:58.722 UTC [10981] LOG: database system is ready to accept connections
I20260811 07:03:59.811004 31013 mini_postgres.cc:96] Postgres bound to 41471
2026-08-11 07:03:59.836 UTC [10994] FATAL: database "slave" does not exist
127.30.73.84:41471 - accepting connections
I20260811 07:03:59.836841 31013 mini_ranger.cc:161] Starting Ranger...
I20260811 07:03:59.868480 31013 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 07:04:00.488530 31013 mini_ranger.cc:87] Created ranger Postgres database
I20260811 07:04:00.488696 31013 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-admin
2026-08-11 07:04:00,824 [I] DB FLAVOR :POSTGRES
2026-08-11 07:04:00,825 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:04:00,825 [I] Checking connection..
2026-08-11 07:04:00,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 07:04:01,150 [I] Checking connection passed.
2026-08-11 07:04:01,150 [I] --------- Verifying version history table ---------
2026-08-11 07:04:01,150 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:04:01,429 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:04:01,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:04:01,679 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:04:01,680 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 07:04:01,680 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 07:04:01.913 UTC [11065] WARNING: there is no transaction in progress
2026-08-11 07:04:01,921 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 07:04:01,922 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:04:02,206 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 07:04:02,207 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:04:02,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 07:04:02,470 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 07:04:02,723 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-69rg.c.gcp-upstream.internal','N') ;"
2026-08-11 07:04:02,976 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:04:03,232 [I] Table x_portal_user does not exist in database ranger
2026-08-11 07:04:03,232 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:04:03,492 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 07:04:03,493 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:04:03,754 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:04:03,994 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 07:04:03,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 07:04:05.022 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.043 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.061 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.078 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.095 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.117 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.175 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.182 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.198 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.208 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.219 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.234 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.245 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.252 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.260 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:05.267 UTC [11192] WARNING: there is no transaction in progress
2026-08-11 07:04:06,036 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 07:04:06,036 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 07:04:06,305 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 07:04:06,306 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:04:06,558 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 07:04:06,559 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:04:06,813 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 07:04:06,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:04:07,058 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:04:07,330 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-69rg.c.gcp-upstream.internal';"
2026-08-11 07:04:07,602 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 07:04:07,602 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 07:04:07,877 [I] DB_PATCHES have already been applied
I20260811 07:04:07.884097 31013 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-admin:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskgm9MY0/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 07:04:07.884212 31013 mini_ranger.cc:193] Using host: 127.30.73.84
I20260811 07:04:07.907548 31013 mini_ranger.cc:227] Ranger admin URL: http://127.30.73.84:44449
Aug 11, 2026 7:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 7:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 7:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 7:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 7:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 07:04:09.215018 31013 mini_ranger.cc:160] Time spent starting Ranger: real 9.378s user 0.009s sys 0.060s
Aug 11, 2026 7:04:31 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 7:04:31 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 7:04:31 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 7:04:31 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 7:04:32 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 07:04:33.548089 31013 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.73.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.73.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/rangerkms_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/rangerkms_127.30.73.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.73.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.73.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.73.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/HTTP_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.73.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/HTTP_127.30.73.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 07:04:33 dist-test-slave-69rg krb5kdc[10948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431873, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 07:04:33.799880 31013 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 07:04:33.831235 31013 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 07:04:34.955770 31013 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 07:04:34.955981 31013 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-kms
I20260811 07:04:34.956117 31013 mini_ranger_kms.cc:227] Using postgres at 127.30.73.84:41471
2026-08-11 07:04:35,696 [I] DB FLAVOR :POSTGRES
2026-08-11 07:04:35,696 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:04:35,696 [I] Checking connection
2026-08-11 07:04:35,697 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 07:04:35,948 [I] connection success
2026-08-11 07:04:35,948 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 07:04:35,948 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 07:04:35,948 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 07:04:36,223 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 07:04:36,223 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:04:36,224 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 07:04:36,224 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:41471/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 07:04:36,524 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 07:04:37.063418 31013 mini_ranger_kms.cc:310] Created kms service
I20260811 07:04:37.284806 31013 mini_ranger_kms.cc:326] Created kudu user
I20260811 07:04:37.331424 31013 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 07:04:37 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431873, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:04:37.759820 31013 mini_ranger_kms.cc:384] Added ranger policy
I20260811 07:04:37.760166 31013 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-kms:/tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 07:04:37.760244 31013 mini_ranger_kms.cc:240] Using host: 127.30.73.84
I20260811 07:04:37.791642 31013 mini_ranger_kms.cc:276] Ranger KMS PID: 11419
I20260811 07:04:37.791864 31013 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.73.84:50597
Aug 11, 2026 7:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 7:04:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 7:04:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 7:04:39 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 07:04:40 dist-test-slave-69rg krb5kdc[10948](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431880, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.73.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:04:40.295768 31013 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.496s user 0.092s sys 0.514s
I20260811 07:04:40.296154 31013 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 07:04:40.296387 31013 mini_ranger_kms.cc:401] 127.30.73.84:50597/kms/v1/keys
Aug 11 07:04:40 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431880, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.73.84@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
Aug 11 07:04:41 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431880, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.73.84@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
Aug 11 07:04:43 dist-test-slave-69rg krb5kdc[10948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:04:43.422778 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:33281
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:38635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:33281
--ranger_config_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:50597/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:04:43.794310 11478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:04:43.794634 11478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:04:43.794724 11478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:04:43.802011 11478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:04:43.802122 11478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:04:43.802167 11478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:04:43.802246 11478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:04:43.802296 11478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:04:43.812443 11478 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:38635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.73.84:50597/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:33281
--ranger_config_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:33281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:04:43.813756 11478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:04:43.815075 11478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:04:43.828737 11484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:04:43.828722 11487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:04:43.828737 11485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:04:43.829286 11478 server_base.cc:1034] running on GCE node
I20260811 07:04:43.830277 11478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:04:43.831875 11478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:04:43.833163 11478 hybrid_clock.cc:648] HybridClock initialized: now 1786431883833098 us; error 54 us; skew 500 ppm
I20260811 07:04:43.833586 11478 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:04:43 dist-test-slave-69rg krb5kdc[10948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431883, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:04:43.841346 11478 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:04:43.843015 11478 webserver.cc:460] Webserver started at http://127.30.73.126:43941/ using document root <none> and password file <none>
I20260811 07:04:43.843739 11478 fs_manager.cc:359] Metadata directory not provided
I20260811 07:04:43.843891 11478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:04:43.844221 11478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:04:43 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431883, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:04:43.914233 11478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "32d4ccbfa6204db69aa1995e525013ca"
format_stamp: "Formatted at 2026-08-11 07:04:43 on dist-test-slave-69rg"
server_key: "c1e5d036441de97c66301916648904eb"
server_key_iv: "1af959bae651c8ba832e8da5fecd616a"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:43.915158 11478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "32d4ccbfa6204db69aa1995e525013ca"
format_stamp: "Formatted at 2026-08-11 07:04:43 on dist-test-slave-69rg"
server_key: "c1e5d036441de97c66301916648904eb"
server_key_iv: "1af959bae651c8ba832e8da5fecd616a"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:43.921073 11478 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:04:43.941133 11494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:04:43.943069 11478 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:04:43.943305 11478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "32d4ccbfa6204db69aa1995e525013ca"
format_stamp: "Formatted at 2026-08-11 07:04:43 on dist-test-slave-69rg"
server_key: "c1e5d036441de97c66301916648904eb"
server_key_iv: "1af959bae651c8ba832e8da5fecd616a"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:43.943590 11478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:04:43.964184 11478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:04:43.968397 11478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:04:43.968748 11478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:04:44.006762 11478 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:33281
I20260811 07:04:44.006865 11553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:33281 every 8 connection(s)
I20260811 07:04:44.008302 11478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:04:44.010838 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 11478
I20260811 07:04:44.011081 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:04:44.011802 31013 external_mini_cluster.cc:1428] Setting key ebcffa1c6e37c3564c1a333c4ea32ec1
I20260811 07:04:44.013702 11554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:04:44.029524 11554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca: Bootstrap starting.
I20260811 07:04:44.033463 11554 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca: Neither blocks nor log segments found. Creating new log.
I20260811 07:04:44.034962 11554 log.cc:824] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca: Log is configured to *not* fsync() on all Append() calls
I20260811 07:04:44.039608 11554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca: No bootstrap required, opened a new log
Aug 11 07:04:44 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:04:44.050549 11554 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d4ccbfa6204db69aa1995e525013ca" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 33281 } }
I20260811 07:04:44.051106 11554 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:04:44.051242 11554 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d4ccbfa6204db69aa1995e525013ca, State: Initialized, Role: FOLLOWER
I20260811 07:04:44.052003 11554 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d4ccbfa6204db69aa1995e525013ca" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 33281 } }
I20260811 07:04:44.052331 11554 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:04:44.052489 11554 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:04:44.052753 11554 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:04:44.056159 11554 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d4ccbfa6204db69aa1995e525013ca" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 33281 } }
I20260811 07:04:44.056861 11554 leader_election.cc:302] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32d4ccbfa6204db69aa1995e525013ca; no voters:
I20260811 07:04:44.058202 11558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:44.014225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34792 (local address 127.30.73.126:33281)
0811 07:04:44.030999 (+ 16774us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:44.031017 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:44.031074 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:04:44.033550 (+ 2476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:44.033583 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:44.034211 (+ 628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:44.034680 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:04:44.036739 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:44.039230 (+ 2491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:44.041142 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:44.042273 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:44.042472 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:44.047911 (+ 5439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:04:44.047924 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:04:44.047956 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:04:44.048016 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:04:44.052442 (+ 4426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:44.053447 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:44.053459 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:44.053473 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:44.053694 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:44.054201 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:44.054206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:44.054210 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:44.055040 (+ 830us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:04:44.055332 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:44.055938 (+ 606us) server_negotiation.cc:299] Negotiation successful
0811 07:04:44.056493 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16514,"thread_start_us":16230,"threads_started":1}
I20260811 07:04:44.058256 11554 leader_election.cc:288] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:04:44.058387 11560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:04:44.065083 11560 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [term 1 LEADER]: Becoming Leader. State: Replica: 32d4ccbfa6204db69aa1995e525013ca, State: Running, Role: LEADER
I20260811 07:04:44.065758 11554 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:04:44.065876 11560 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d4ccbfa6204db69aa1995e525013ca" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 33281 } }
I20260811 07:04:44.075484 11562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32d4ccbfa6204db69aa1995e525013ca. Latest consensus state: current_term: 1 leader_uuid: "32d4ccbfa6204db69aa1995e525013ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d4ccbfa6204db69aa1995e525013ca" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 33281 } } }
I20260811 07:04:44.075891 11562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [sys.catalog]: This master's current role is: LEADER
I20260811 07:04:44.075258 11561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32d4ccbfa6204db69aa1995e525013ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d4ccbfa6204db69aa1995e525013ca" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 33281 } } }
I20260811 07:04:44.076658 11561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca [sys.catalog]: This master's current role is: LEADER
I20260811 07:04:44.081293 11566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:04:44.087154 11566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:04:44.109150 11566 catalog_manager.cc:1347] Generated new cluster ID: b9deb38ab8ef40149e979aceadbe3c80
I20260811 07:04:44.109432 11566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:04:44.136289 11554 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:04:44.170902 11566 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:04:44.172413 11566 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:04:44.185034 11566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca: Generated new TSK 0
I20260811 07:04:44.186107 11566 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:04:44.951920 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:50597/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:33281
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:38635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:04:45 dist-test-slave-69rg krb5kdc[10948](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431885, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 07:04:45.414117 11610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:04:45.414458 11610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:04:45.414639 11610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:04:45.423255 11610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:04:45.423420 11610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:04:45.423615 11610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:04:45.436167 11610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:38635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.73.84:50597/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:33281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:04:45.437968 11610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:04:45.439730 11610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:04:45.458457 11623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:04:45.458474 11622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:04:45.459369 11625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:04:45.460956 11610 server_base.cc:1034] running on GCE node
I20260811 07:04:45.461719 11610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:04:45.463073 11610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:04:45.464355 11610 hybrid_clock.cc:648] HybridClock initialized: now 1786431885464277 us; error 64 us; skew 500 ppm
I20260811 07:04:45.464808 11610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:04:45 dist-test-slave-69rg krb5kdc[10948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431885, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:04:45.468801 11610 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:04:45.472956 11610 webserver.cc:460] Webserver started at http://127.30.73.65:35875/ using document root <none> and password file <none>
I20260811 07:04:45.474201 11610 fs_manager.cc:359] Metadata directory not provided
I20260811 07:04:45.474453 11610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:04:45.474951 11610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:04:45 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431885, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:04:45.495656 11610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "193a1f2623774983b2ed73486e30d6d0"
format_stamp: "Formatted at 2026-08-11 07:04:45 on dist-test-slave-69rg"
server_key: "f74f2a85a273c1a38de593f096a8f4c8"
server_key_iv: "62d7a88835bfb7973449ef69d2f743ed"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:45.496866 11610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "193a1f2623774983b2ed73486e30d6d0"
format_stamp: "Formatted at 2026-08-11 07:04:45 on dist-test-slave-69rg"
server_key: "f74f2a85a273c1a38de593f096a8f4c8"
server_key_iv: "62d7a88835bfb7973449ef69d2f743ed"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:45.524680 11610 fs_manager.cc:691] Time spent creating directory manager: real 0.027s user 0.014s sys 0.015s
I20260811 07:04:45.557276 11633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:04:45.566186 11610 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.003s sys 0.001s
I20260811 07:04:45.566476 11610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "193a1f2623774983b2ed73486e30d6d0"
format_stamp: "Formatted at 2026-08-11 07:04:45 on dist-test-slave-69rg"
server_key: "f74f2a85a273c1a38de593f096a8f4c8"
server_key_iv: "62d7a88835bfb7973449ef69d2f743ed"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:45.566912 11610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:04:45.622949 11610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:04:45.638279 11610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:04:45.638764 11610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:04:45.640659 11610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:04:45.645669 11610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:04:45.645903 11610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 07:04:45.646140 11610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:04:45.646386 11610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:04:45 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431885, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:04:45.994071 11756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:44321 every 8 connection(s)
I20260811 07:04:45.994457 11610 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:44321
I20260811 07:04:45.997025 11610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:04:46.002679 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 11610
I20260811 07:04:46.002907 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:04:46.004269 31013 external_mini_cluster.cc:1428] Setting key dd6500af8859eb89a7cfb9dabc82dee2
Aug 11 07:04:46 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431885, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:04:46.106380 11760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:46.040980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:57043 (local address 127.30.73.126:33281)
0811 07:04:46.050869 (+ 9889us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:46.050880 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:46.058567 (+ 7687us) server_negotiation.cc:407] Connection header received
0811 07:04:46.058662 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:46.058668 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:46.058772 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:46.058883 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:04:46.078085 (+ 19202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:46.079951 (+ 1866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:46.084080 (+ 4129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:46.085512 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:46.085857 (+ 345us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:46.094163 (+ 8306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:04:46.094174 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:04:46.094179 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:04:46.094234 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:04:46.100302 (+ 6068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:46.101962 (+ 1660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:46.101972 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:46.101979 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:46.102308 (+ 329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:46.103331 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:46.103337 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:46.103341 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:46.103853 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:04:46.103997 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:46.105235 (+ 1238us) server_negotiation.cc:299] Negotiation successful
0811 07:04:46.105558 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9647,"thread_start_us":9243,"threads_started":1}
I20260811 07:04:46.109596 11759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:46.039743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:33281 (local address 127.30.73.65:57043)
0811 07:04:46.054934 (+ 15191us) negotiation.cc:107] Waiting for socket to connect
0811 07:04:46.055002 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 07:04:46.058026 (+ 3024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:04:46.059629 (+ 1603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:04:46.059648 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:04:46.061079 (+ 1431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:04:46.068186 (+ 7107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:46.068246 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:46.080232 (+ 11986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:46.080242 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:46.083814 (+ 3572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:46.083845 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:46.086945 (+ 3100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:46.086961 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:46.087681 (+ 720us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:46.089018 (+ 1337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:04:46.089062 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:04:46.093618 (+ 4556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:04:46.100690 (+ 7072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:04:46.100706 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:04:46.100731 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:04:46.101738 (+ 1007us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:04:46.102544 (+ 806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:04:46.102552 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:04:46.102559 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:04:46.103152 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:04:46.104112 (+ 960us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:04:46.104122 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:04:46.104712 (+ 590us) client_negotiation.cc:769] Sending connection context
0811 07:04:46.107072 (+ 2360us) client_negotiation.cc:240] Negotiation successful
0811 07:04:46.107772 (+ 700us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14590,"thread_start_us":11961,"threads_started":1}
I20260811 07:04:46.113158 11757 heartbeater.cc:347] Connected to a master server at 127.30.73.126:33281
I20260811 07:04:46.113797 11757 heartbeater.cc:464] Registering TS with master...
I20260811 07:04:46.115520 11757 heartbeater.cc:511] Master 127.30.73.126:33281 requested a full tablet report, sending...
I20260811 07:04:46.119182 11514 ts_manager.cc:194] Registered new tserver with Master: 193a1f2623774983b2ed73486e30d6d0 (127.30.73.65:44321)
I20260811 07:04:46.121788 11514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:57043
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
W20260811 07:04:46.209300 31013 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.30.73.66: real 0.199s user 0.006s sys 0.027s
I20260811 07:04:46.210333 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:50597/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:33281
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:38635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:04:46 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431885, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
W20260811 07:04:46.906009 11766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:04:46.906324 11766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:04:46.906430 11766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:04:46.915337 11766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:04:46.915594 11766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:04:46.915805 11766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:04:46.927981 11766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:38635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.73.84:50597/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:33281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:04:46.929438 11766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:04:46.930962 11766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:04:46.949306 11783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:04:46.950665 11786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:04:46.950781 11784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:04:46.952551 11766 server_base.cc:1034] running on GCE node
I20260811 07:04:46.953435 11766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:04:46.954716 11766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:04:46.956063 11766 hybrid_clock.cc:648] HybridClock initialized: now 1786431886955916 us; error 59 us; skew 500 ppm
I20260811 07:04:46.956529 11766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:04:46 dist-test-slave-69rg krb5kdc[10948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431886, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:04:46.962230 11766 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:04:46.964762 11766 webserver.cc:460] Webserver started at http://127.30.73.66:35891/ using document root <none> and password file <none>
I20260811 07:04:46.965852 11766 fs_manager.cc:359] Metadata directory not provided
I20260811 07:04:46.966099 11766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:04:46.966744 11766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:04:46 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431886, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:04:46.985760 11766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "7ee5b57d6e874050adfb00915aec4585"
format_stamp: "Formatted at 2026-08-11 07:04:46 on dist-test-slave-69rg"
server_key: "b4f21f91e515c55b1e6e7c98c071c71b"
server_key_iv: "dc8eaeb37cea3814085db8a15a311957"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:46.987056 11766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "7ee5b57d6e874050adfb00915aec4585"
format_stamp: "Formatted at 2026-08-11 07:04:46 on dist-test-slave-69rg"
server_key: "b4f21f91e515c55b1e6e7c98c071c71b"
server_key_iv: "dc8eaeb37cea3814085db8a15a311957"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:46.994251 11766 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260811 07:04:47.014488 11794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:04:47.016748 11766 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.004s
I20260811 07:04:47.017031 11766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "7ee5b57d6e874050adfb00915aec4585"
format_stamp: "Formatted at 2026-08-11 07:04:46 on dist-test-slave-69rg"
server_key: "b4f21f91e515c55b1e6e7c98c071c71b"
server_key_iv: "dc8eaeb37cea3814085db8a15a311957"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:47.017319 11766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:04:47.040153 11766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:04:47.045238 11766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:04:47.045629 11766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:04:47.047120 11766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:04:47.049186 11766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:04:47.049314 11766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:04:47.049539 11766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:04:47.049646 11766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:04:47.129159 11757 heartbeater.cc:503] Master 127.30.73.126:33281 was elected leader, sending a full tablet report...
I20260811 07:04:47.129906 11766 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:40803
I20260811 07:04:47.129987 11929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:40803 every 8 connection(s)
I20260811 07:04:47.131729 11766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:04:47.140456 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 11766
I20260811 07:04:47.140645 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:04:47.141285 31013 external_mini_cluster.cc:1428] Setting key 9ed835bbcf3fef71344456b2ea5bed31
Aug 11 07:04:47 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431886, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:04:47.164110 11933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:47.135329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:45339 (local address 127.30.73.126:33281)
0811 07:04:47.136201 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:47.136207 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:47.138029 (+ 1822us) server_negotiation.cc:407] Connection header received
0811 07:04:47.140972 (+ 2943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:47.140976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:47.141043 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:47.141136 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:04:47.143506 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:47.145225 (+ 1719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:47.147370 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:47.147885 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:47.148040 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:47.156020 (+ 7980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:04:47.156030 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:04:47.156037 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:04:47.156082 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:04:47.160124 (+ 4042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:47.161063 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:47.161072 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:47.161079 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:47.161259 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:47.161963 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:47.161971 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:47.161978 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:47.162427 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:04:47.162605 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:47.163350 (+ 745us) server_negotiation.cc:299] Negotiation successful
0811 07:04:47.163604 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":479,"threads_started":1}
I20260811 07:04:47.165096 11934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:47.136280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:33281 (local address 127.30.73.66:45339)
0811 07:04:47.137798 (+ 1518us) negotiation.cc:107] Waiting for socket to connect
0811 07:04:47.137903 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0811 07:04:47.140678 (+ 2775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:04:47.141457 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:04:47.141468 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:04:47.142439 (+ 971us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:04:47.143285 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:47.143305 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:47.145466 (+ 2161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:47.145470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:47.147214 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:47.147228 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:47.148273 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:47.148286 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:47.148654 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:47.150116 (+ 1462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:04:47.150153 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:04:47.155714 (+ 5561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:04:47.160297 (+ 4583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:04:47.160305 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:04:47.160319 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:04:47.160893 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:04:47.161388 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:04:47.161392 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:04:47.161394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:04:47.161788 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:04:47.162565 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:04:47.162571 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:04:47.162892 (+ 321us) client_negotiation.cc:769] Sending connection context
0811 07:04:47.163181 (+ 289us) client_negotiation.cc:240] Negotiation successful
0811 07:04:47.163662 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1236,"thread_start_us":817,"threads_started":1}
I20260811 07:04:47.167126 11930 heartbeater.cc:347] Connected to a master server at 127.30.73.126:33281
I20260811 07:04:47.167601 11930 heartbeater.cc:464] Registering TS with master...
I20260811 07:04:47.168640 11930 heartbeater.cc:511] Master 127.30.73.126:33281 requested a full tablet report, sending...
I20260811 07:04:47.170368 11514 ts_manager.cc:194] Registered new tserver with Master: 7ee5b57d6e874050adfb00915aec4585 (127.30.73.66:40803)
I20260811 07:04:47.171283 11514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:45339
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:04:47.214052 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:50597/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:33281
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:38635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:04:47.809744 11937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:04:47.810161 11937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:04:47.810395 11937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:04:47.820375 11937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:04:47.820580 11937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:04:47.820824 11937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:04:47.834049 11937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:38635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.73.84:50597/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:33281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:04:47.835644 11937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:04:47.837080 11937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:04:47.856810 11942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:04:47.856879 11946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:04:47.856788 11943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:04:47.858584 11937 server_base.cc:1034] running on GCE node
I20260811 07:04:47.859453 11937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:04:47.860682 11937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:04:47.861980 11937 hybrid_clock.cc:648] HybridClock initialized: now 1786431887861972 us; error 110 us; skew 500 ppm
I20260811 07:04:47.862488 11937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:04:47 dist-test-slave-69rg krb5kdc[10948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431887, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:04:47.866993 11937 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:04:47.868960 11937 webserver.cc:460] Webserver started at http://127.30.73.67:35369/ using document root <none> and password file <none>
I20260811 07:04:47.870009 11937 fs_manager.cc:359] Metadata directory not provided
I20260811 07:04:47.870214 11937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:04:47.870580 11937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:04:47 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431887, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:04:47.888659 11937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "4bfb16a6ab104b14bbc090731c48bc4b"
format_stamp: "Formatted at 2026-08-11 07:04:47 on dist-test-slave-69rg"
server_key: "1d65075ddacdc458c6e33d15cccbc251"
server_key_iv: "69da60ea4da0e36a5867463018ea3312"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:47.889707 11937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "4bfb16a6ab104b14bbc090731c48bc4b"
format_stamp: "Formatted at 2026-08-11 07:04:47 on dist-test-slave-69rg"
server_key: "1d65075ddacdc458c6e33d15cccbc251"
server_key_iv: "69da60ea4da0e36a5867463018ea3312"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:47.896888 11937 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260811 07:04:47.914983 11955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:04:47.916641 11937 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260811 07:04:47.916920 11937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "4bfb16a6ab104b14bbc090731c48bc4b"
format_stamp: "Formatted at 2026-08-11 07:04:47 on dist-test-slave-69rg"
server_key: "1d65075ddacdc458c6e33d15cccbc251"
server_key_iv: "69da60ea4da0e36a5867463018ea3312"
server_key_version: "kuduclusterkey@0"
I20260811 07:04:47.917196 11937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:04:47.940483 11937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:04:47.946139 11937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:04:47.946552 11937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:04:47.948179 11937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:04:47.950500 11937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:04:47.950596 11937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:04:47.950798 11937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:04:47.950882 11937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:04:48.033246 11937 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:33303
I20260811 07:04:48.033279 12084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:33303 every 8 connection(s)
I20260811 07:04:48.035377 11937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:04:48.040714 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 11937
I20260811 07:04:48.040908 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:04:48.041468 31013 external_mini_cluster.cc:1428] Setting key 374f2d77f0e7ee72ecc9173fe6e1e87b
Aug 11 07:04:48 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431887, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:04:48.069232 12087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.039683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:57059 (local address 127.30.73.126:33281)
0811 07:04:48.040688 (+ 1005us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.040696 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.043276 (+ 2580us) server_negotiation.cc:407] Connection header received
0811 07:04:48.046094 (+ 2818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.046099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.046222 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.046323 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:04:48.048643 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.049887 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.052319 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.052922 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.053059 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.058428 (+ 5369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:04:48.058434 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:04:48.058437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:04:48.058499 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:04:48.064013 (+ 5514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.065261 (+ 1248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.065267 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.065271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.065571 (+ 300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.066412 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.066418 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.066422 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.067005 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:04:48.067198 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.068505 (+ 1307us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.068720 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":849,"thread_start_us":670,"threads_started":1}
I20260811 07:04:48.070703 12088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.040923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:33281 (local address 127.30.73.67:57059)
0811 07:04:48.043037 (+ 2114us) negotiation.cc:107] Waiting for socket to connect
0811 07:04:48.043121 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 07:04:48.045723 (+ 2602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:04:48.046722 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:04:48.046736 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:04:48.047615 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:04:48.048470 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.048491 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.050139 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.050144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.052136 (+ 1992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.052152 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.053247 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.053254 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.053570 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.054597 (+ 1027us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:04:48.054672 (+ 75us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:04:48.058075 (+ 3403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:04:48.064284 (+ 6209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:04:48.064293 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:04:48.064310 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:04:48.065048 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:04:48.065730 (+ 682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:04:48.065735 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:04:48.065760 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:04:48.066268 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:04:48.067285 (+ 1017us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:04:48.067295 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:04:48.067947 (+ 652us) client_negotiation.cc:769] Sending connection context
0811 07:04:48.068374 (+ 427us) client_negotiation.cc:240] Negotiation successful
0811 07:04:48.068915 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1656,"thread_start_us":1209,"threads_started":1}
I20260811 07:04:48.072502 12085 heartbeater.cc:347] Connected to a master server at 127.30.73.126:33281
I20260811 07:04:48.073012 12085 heartbeater.cc:464] Registering TS with master...
I20260811 07:04:48.074237 12085 heartbeater.cc:511] Master 127.30.73.126:33281 requested a full tablet report, sending...
I20260811 07:04:48.075925 11514 ts_manager.cc:194] Registered new tserver with Master: 4bfb16a6ab104b14bbc090731c48bc4b (127.30.73.67:33303)
I20260811 07:04:48.076926 11514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:57059
I20260811 07:04:48.084668 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:04:48.111104 12087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.091212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34802 (local address 127.30.73.126:33281)
0811 07:04:48.091399 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.091404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.092172 (+ 768us) server_negotiation.cc:407] Connection header received
0811 07:04:48.092405 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.092409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.092491 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.092599 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:04:48.094986 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.096218 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.098821 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.099652 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.099795 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.103515 (+ 3720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:04:48.103520 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:04:48.103523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:04:48.103564 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:04:48.107254 (+ 3690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.108234 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.108240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.108243 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.108435 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.108934 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.108939 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.108943 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.109356 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:04:48.109720 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.110230 (+ 510us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.110536 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:04:48.116559 11514 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:04:48.126981 11514 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:04:48.161618 12098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.144643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:44321 (local address 127.0.0.1:51104)
0811 07:04:48.148424 (+ 3781us) negotiation.cc:107] Waiting for socket to connect
0811 07:04:48.148466 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:04:48.148768 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:04:48.149759 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:04:48.149768 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:04:48.149800 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:04:48.151667 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.151688 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.154849 (+ 3161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.154854 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.157560 (+ 2706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.157609 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.160503 (+ 2894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.160508 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.160711 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.160747 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:04:48.160899 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 07:04:48.161104 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3498,"thread_start_us":3254,"threads_started":1}
I20260811 07:04:48.161725 12099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.145216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51104 (local address 127.30.73.65:44321)
0811 07:04:48.146758 (+ 1542us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.146770 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.148949 (+ 2179us) server_negotiation.cc:407] Connection header received
0811 07:04:48.149142 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.149160 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.149472 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.149773 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:04:48.152300 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.154684 (+ 2384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.157849 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.159906 (+ 2057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.160043 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.160341 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.160972 (+ 631us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.161165 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1227,"thread_start_us":929,"threads_started":1}
I20260811 07:04:48.163770 12102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.147020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:33303 (local address 127.0.0.1:34246)
0811 07:04:48.149986 (+ 2966us) negotiation.cc:107] Waiting for socket to connect
0811 07:04:48.150006 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:04:48.150504 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:04:48.151706 (+ 1202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:04:48.151710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:04:48.151747 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:04:48.153282 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.153313 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.156397 (+ 3084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.156404 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.160098 (+ 3694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.160113 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.162899 (+ 2786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.162907 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.163103 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.163134 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:04:48.163223 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 07:04:48.163356 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2668,"mutex_wait_us":133,"thread_start_us":2318,"threads_started":1}
I20260811 07:04:48.164489 12104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.150722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42364 (local address 127.30.73.66:40803)
0811 07:04:48.152242 (+ 1520us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.152250 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.152278 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:04:48.152370 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.152376 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.152631 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.152856 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:04:48.154182 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.156598 (+ 2416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.159914 (+ 3316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.161840 (+ 1926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.162057 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.162379 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.163728 (+ 1349us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.163939 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1315,"thread_start_us":1119,"threads_started":1}
I20260811 07:04:48.164861 12100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.146255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34246 (local address 127.30.73.67:33303)
0811 07:04:48.149135 (+ 2880us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.149149 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.150120 (+ 971us) server_negotiation.cc:407] Connection header received
0811 07:04:48.150790 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.150799 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.151049 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.151267 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:04:48.153561 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.156208 (+ 2647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.160276 (+ 4068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.162330 (+ 2054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.162479 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.162723 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.164163 (+ 1440us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.164362 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2602,"thread_start_us":2409,"threads_started":1}
I20260811 07:04:48.167520 12103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.150212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:40803 (local address 127.0.0.1:42364)
0811 07:04:48.151300 (+ 1088us) negotiation.cc:107] Waiting for socket to connect
0811 07:04:48.151319 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:04:48.151484 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:04:48.152841 (+ 1357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:04:48.152846 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:04:48.152871 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:04:48.153810 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.153863 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.156783 (+ 2920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.156788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.159734 (+ 2946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.159747 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.162136 (+ 2389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.162143 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.162342 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.162377 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 07:04:48.162480 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 07:04:48.162661 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"mutex_wait_us":2,"thread_start_us":867,"threads_started":1}
I20260811 07:04:48.168193 11688 tablet_service.cc:1467] Processing CreateTablet for tablet d62e68deedde466dad57070f7ad58761 (DEFAULT_TABLE table=test-table [id=07b597be9e494bbba43be2080caae01a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:04:48.168903 12009 tablet_service.cc:1467] Processing CreateTablet for tablet d62e68deedde466dad57070f7ad58761 (DEFAULT_TABLE table=test-table [id=07b597be9e494bbba43be2080caae01a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:04:48.170158 11688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d62e68deedde466dad57070f7ad58761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:04:48.170352 12009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d62e68deedde466dad57070f7ad58761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:04:48.175483 11930 heartbeater.cc:503] Master 127.30.73.126:33281 was elected leader, sending a full tablet report...
I20260811 07:04:48.178400 11855 tablet_service.cc:1467] Processing CreateTablet for tablet d62e68deedde466dad57070f7ad58761 (DEFAULT_TABLE table=test-table [id=07b597be9e494bbba43be2080caae01a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:04:48.180151 11855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d62e68deedde466dad57070f7ad58761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:04:48.189756 12105 tablet_bootstrap.cc:492] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: Bootstrap starting.
I20260811 07:04:48.195089 12106 tablet_bootstrap.cc:492] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: Bootstrap starting.
I20260811 07:04:48.195953 12105 tablet_bootstrap.cc:654] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: Neither blocks nor log segments found. Creating new log.
I20260811 07:04:48.198359 12105 log.cc:824] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:04:48.201215 12106 tablet_bootstrap.cc:654] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: Neither blocks nor log segments found. Creating new log.
I20260811 07:04:48.202396 12108 tablet_bootstrap.cc:492] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: Bootstrap starting.
I20260811 07:04:48.203469 12105 tablet_bootstrap.cc:492] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: No bootstrap required, opened a new log
I20260811 07:04:48.203730 12106 log.cc:824] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: Log is configured to *not* fsync() on all Append() calls
I20260811 07:04:48.203843 12105 ts_tablet_manager.cc:1397] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260811 07:04:48.208060 12108 tablet_bootstrap.cc:654] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: Neither blocks nor log segments found. Creating new log.
I20260811 07:04:48.208746 12106 tablet_bootstrap.cc:492] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: No bootstrap required, opened a new log
I20260811 07:04:48.209187 12106 ts_tablet_manager.cc:1397] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.012s
I20260811 07:04:48.210947 12108 log.cc:824] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: Log is configured to *not* fsync() on all Append() calls
I20260811 07:04:48.216156 12108 tablet_bootstrap.cc:492] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: No bootstrap required, opened a new log
I20260811 07:04:48.216569 12108 ts_tablet_manager.cc:1397] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260811 07:04:48.217597 12105 raft_consensus.cc:348] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } }
I20260811 07:04:48.218142 12105 raft_consensus.cc:374] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:04:48.218370 12105 raft_consensus.cc:729] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bfb16a6ab104b14bbc090731c48bc4b, State: Initialized, Role: FOLLOWER
I20260811 07:04:48.219193 12105 consensus_queue.cc:260] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } }
I20260811 07:04:48.221019 12085 heartbeater.cc:503] Master 127.30.73.126:33281 was elected leader, sending a full tablet report...
I20260811 07:04:48.221660 12105 ts_tablet_manager.cc:1428] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: Time spent starting tablet: real 0.018s user 0.005s sys 0.011s
I20260811 07:04:48.224537 12106 raft_consensus.cc:348] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } }
I20260811 07:04:48.225102 12106 raft_consensus.cc:374] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:04:48.225293 12106 raft_consensus.cc:729] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 193a1f2623774983b2ed73486e30d6d0, State: Initialized, Role: FOLLOWER
I20260811 07:04:48.226116 12106 consensus_queue.cc:260] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } }
I20260811 07:04:48.230620 12106 ts_tablet_manager.cc:1428] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: Time spent starting tablet: real 0.021s user 0.013s sys 0.007s
I20260811 07:04:48.232214 12108 raft_consensus.cc:348] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } }
I20260811 07:04:48.232839 12108 raft_consensus.cc:374] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:04:48.233026 12108 raft_consensus.cc:729] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee5b57d6e874050adfb00915aec4585, State: Initialized, Role: FOLLOWER
I20260811 07:04:48.233896 12108 consensus_queue.cc:260] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } }
I20260811 07:04:48.236423 12108 ts_tablet_manager.cc:1428] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: Time spent starting tablet: real 0.020s user 0.011s sys 0.009s
W20260811 07:04:48.287809 12086 tablet.cc:2369] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:04:48.294850 11758 tablet.cc:2369] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:04:48.327523 12115 raft_consensus.cc:482] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:04:48.327950 12115 raft_consensus.cc:504] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } }
I20260811 07:04:48.329900 12115 leader_election.cc:288] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 193a1f2623774983b2ed73486e30d6d0 (127.30.73.65:44321), 4bfb16a6ab104b14bbc090731c48bc4b (127.30.73.67:33303)
I20260811 07:04:48.342020 12100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.330868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:59435 (local address 127.30.73.67:33303)
0811 07:04:48.331442 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.331448 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.331953 (+ 505us) server_negotiation.cc:407] Connection header received
0811 07:04:48.332298 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.332302 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.332368 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.332447 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:04:48.333456 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.334769 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.338767 (+ 3998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.340548 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.340728 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.340805 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.341548 (+ 743us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.341688 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385}
I20260811 07:04:48.342072 12099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.330494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:47771 (local address 127.30.73.65:44321)
0811 07:04:48.331224 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.331233 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.332709 (+ 1476us) server_negotiation.cc:407] Connection header received
0811 07:04:48.332991 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.332995 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.333056 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.333138 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:04:48.334219 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.335269 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.338906 (+ 3637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.340533 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.340726 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.340805 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.341548 (+ 743us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.341700 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514}
I20260811 07:04:48.342774 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.330292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:44321 (local address 127.30.73.66:47771)
0811 07:04:48.332521 (+ 2229us) negotiation.cc:107] Waiting for socket to connect
0811 07:04:48.332539 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:04:48.332786 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:04:48.333194 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:04:48.333199 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:04:48.333245 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:04:48.334004 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.334016 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.335449 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.335455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.338705 (+ 3250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.338719 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.341001 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.341009 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.341311 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.341365 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 07:04:48.341480 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:04:48.341703 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2036,"mutex_wait_us":48,"thread_start_us":901,"threads_started":1}
I20260811 07:04:48.342833 12119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.330245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:33303 (local address 127.30.73.66:59435)
0811 07:04:48.331681 (+ 1436us) negotiation.cc:107] Waiting for socket to connect
0811 07:04:48.331712 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 07:04:48.332082 (+ 370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:04:48.332521 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:04:48.332526 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:04:48.332561 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:04:48.333276 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.333291 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.334917 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.334920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.338560 (+ 3640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:04:48.338578 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.341105 (+ 2527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.341111 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:04:48.341380 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.341408 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:04:48.341498 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 07:04:48.341703 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1238,"mutex_wait_us":84,"thread_start_us":1777,"threads_started":1}
I20260811 07:04:48.344413 12033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d62e68deedde466dad57070f7ad58761" candidate_uuid: "7ee5b57d6e874050adfb00915aec4585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" is_pre_election: true
I20260811 07:04:48.344417 11710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d62e68deedde466dad57070f7ad58761" candidate_uuid: "7ee5b57d6e874050adfb00915aec4585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "193a1f2623774983b2ed73486e30d6d0" is_pre_election: true
I20260811 07:04:48.345150 12033 raft_consensus.cc:2454] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee5b57d6e874050adfb00915aec4585 in term 0.
I20260811 07:04:48.345254 11710 raft_consensus.cc:2454] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee5b57d6e874050adfb00915aec4585 in term 0.
I20260811 07:04:48.346331 11797 leader_election.cc:302] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 193a1f2623774983b2ed73486e30d6d0, 4bfb16a6ab104b14bbc090731c48bc4b, 7ee5b57d6e874050adfb00915aec4585; no voters:
I20260811 07:04:48.346968 12115 raft_consensus.cc:2781] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:04:48.347277 12115 raft_consensus.cc:482] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:04:48.347468 12115 raft_consensus.cc:3037] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:04:48.350921 12115 raft_consensus.cc:504] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } }
I20260811 07:04:48.351708 12115 leader_election.cc:288] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [CANDIDATE]: Term 1 election: Requested vote from peers 193a1f2623774983b2ed73486e30d6d0 (127.30.73.65:44321), 4bfb16a6ab104b14bbc090731c48bc4b (127.30.73.67:33303)
I20260811 07:04:48.352321 11710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d62e68deedde466dad57070f7ad58761" candidate_uuid: "7ee5b57d6e874050adfb00915aec4585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "193a1f2623774983b2ed73486e30d6d0"
I20260811 07:04:48.352321 12033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d62e68deedde466dad57070f7ad58761" candidate_uuid: "7ee5b57d6e874050adfb00915aec4585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bfb16a6ab104b14bbc090731c48bc4b"
I20260811 07:04:48.352608 12033 raft_consensus.cc:3037] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:04:48.352581 11710 raft_consensus.cc:3037] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:04:48.357036 11710 raft_consensus.cc:2454] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee5b57d6e874050adfb00915aec4585 in term 1.
I20260811 07:04:48.357052 12033 raft_consensus.cc:2454] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee5b57d6e874050adfb00915aec4585 in term 1.
I20260811 07:04:48.357654 11797 leader_election.cc:302] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 193a1f2623774983b2ed73486e30d6d0, 4bfb16a6ab104b14bbc090731c48bc4b, 7ee5b57d6e874050adfb00915aec4585; no voters:
I20260811 07:04:48.358196 12115 raft_consensus.cc:2781] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:04:48.358978 12115 raft_consensus.cc:686] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 1 LEADER]: Becoming Leader. State: Replica: 7ee5b57d6e874050adfb00915aec4585, State: Running, Role: LEADER
I20260811 07:04:48.359700 12115 consensus_queue.cc:237] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } }
I20260811 07:04:48.365513 11514 catalog_manager.cc:5495] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ee5b57d6e874050adfb00915aec4585 (127.30.73.66). New cstate: current_term: 1 leader_uuid: "7ee5b57d6e874050adfb00915aec4585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ee5b57d6e874050adfb00915aec4585" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 40803 } health_report { overall_health: HEALTHY } } }
W20260811 07:04:48.385471 11931 tablet.cc:2369] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:04:48.400612 12104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.394306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42366 (local address 127.30.73.66:40803)
0811 07:04:48.394563 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.394567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.394585 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:04:48.394675 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.394678 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.394792 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.394929 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:04:48.395471 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.396408 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.398316 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.398781 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.398881 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.399495 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:04:48.400044 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:04:48.400156 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.400312 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.400381 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:04:48.412421 11710 raft_consensus.cc:1261] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [term 1 FOLLOWER]: Refusing update from remote peer 7ee5b57d6e874050adfb00915aec4585: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:04:48.412488 12033 raft_consensus.cc:1261] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [term 1 FOLLOWER]: Refusing update from remote peer 7ee5b57d6e874050adfb00915aec4585: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:04:48.413592 12120 consensus_queue.cc:1035] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "193a1f2623774983b2ed73486e30d6d0" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 44321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:04:48.414042 12115 consensus_queue.cc:1035] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bfb16a6ab104b14bbc090731c48bc4b" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 33303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:04:48.447530 11514 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:04:48.447822 11514 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:04:48.452555 11514 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32d4ccbfa6204db69aa1995e525013ca: Sending DeleteTablet for 3 replicas of tablet d62e68deedde466dad57070f7ad58761
I20260811 07:04:48.453950 11688 tablet_service.cc:1514] Processing DeleteTablet for tablet d62e68deedde466dad57070f7ad58761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:04:48 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:51104
I20260811 07:04:48.454270 12009 tablet_service.cc:1514] Processing DeleteTablet for tablet d62e68deedde466dad57070f7ad58761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:04:48 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:34246
I20260811 07:04:48.454614 11855 tablet_service.cc:1514] Processing DeleteTablet for tablet d62e68deedde466dad57070f7ad58761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:04:48 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:42364
I20260811 07:04:48.455924 12133 tablet_replica.cc:330] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: stopping tablet replica
I20260811 07:04:48.456489 12133 raft_consensus.cc:2229] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:04:48.456727 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 11610
I20260811 07:04:48.457149 12133 raft_consensus.cc:2258] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:04:48.459945 12134 tablet_replica.cc:330] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: stopping tablet replica
I20260811 07:04:48.460808 12134 raft_consensus.cc:2229] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:04:48.461741 12134 raft_consensus.cc:2258] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:04:48.462212 12133 ts_tablet_manager.cc:1905] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:04:48.462553 12135 tablet_replica.cc:330] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: stopping tablet replica
I20260811 07:04:48.464037 12134 ts_tablet_manager.cc:1905] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:04:48.466225 12135 raft_consensus.cc:2229] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:04:48.467196 12135 raft_consensus.cc:2258] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:04:48.469164 12133 ts_tablet_manager.cc:1918] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:04:48.469408 12133 log.cc:1196] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/d62e68deedde466dad57070f7ad58761
I20260811 07:04:48.469661 12135 ts_tablet_manager.cc:1905] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:04:48.470021 12133 ts_tablet_manager.cc:1939] T d62e68deedde466dad57070f7ad58761 P 193a1f2623774983b2ed73486e30d6d0: Deleting consensus metadata
I20260811 07:04:48.472282 11496 catalog_manager.cc:4841] TS 193a1f2623774983b2ed73486e30d6d0 (127.30.73.65:44321): tablet d62e68deedde466dad57070f7ad58761 (table test-table [id=07b597be9e494bbba43be2080caae01a]) successfully deleted
I20260811 07:04:48.473026 12134 ts_tablet_manager.cc:1918] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:04:48.473363 12134 log.cc:1196] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/d62e68deedde466dad57070f7ad58761
I20260811 07:04:48.474133 12134 ts_tablet_manager.cc:1939] T d62e68deedde466dad57070f7ad58761 P 4bfb16a6ab104b14bbc090731c48bc4b: Deleting consensus metadata
I20260811 07:04:48.476384 11497 catalog_manager.cc:4841] TS 4bfb16a6ab104b14bbc090731c48bc4b (127.30.73.67:33303): tablet d62e68deedde466dad57070f7ad58761 (table test-table [id=07b597be9e494bbba43be2080caae01a]) successfully deleted
I20260811 07:04:48.480190 12135 ts_tablet_manager.cc:1918] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:04:48.480449 12135 log.cc:1196] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/d62e68deedde466dad57070f7ad58761
I20260811 07:04:48.481181 12135 ts_tablet_manager.cc:1939] T d62e68deedde466dad57070f7ad58761 P 7ee5b57d6e874050adfb00915aec4585: Deleting consensus metadata
I20260811 07:04:48.483564 11497 catalog_manager.cc:4841] TS 7ee5b57d6e874050adfb00915aec4585 (127.30.73.66:40803): tablet d62e68deedde466dad57070f7ad58761 (table test-table [id=07b597be9e494bbba43be2080caae01a]) successfully deleted
Aug 11 07:04:48 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:04:48.494424 12099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.458800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51110 (local address 127.30.73.65:44321)
0811 07:04:48.458984 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.458992 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.461499 (+ 2507us) server_negotiation.cc:407] Connection header received
0811 07:04:48.461872 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.461878 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.461963 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.462104 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:04:48.474301 (+ 12197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.475742 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.478818 (+ 3076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.479442 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.479606 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.485544 (+ 5938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:04:48.485567 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:04:48.485589 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:04:48.485723 (+ 134us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:04:48.490418 (+ 4695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.491481 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.491492 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.491495 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.491665 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.492147 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.492152 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.492156 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.492655 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:04:48.493004 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.493386 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.493630 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:04:48.495369 11751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:04:48.588675 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 11610
I20260811 07:04:48.620452 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 11766
Aug 11 07:04:48 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:04:48.639565 12104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.621394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42368 (local address 127.30.73.66:40803)
0811 07:04:48.621647 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.621653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.621673 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:04:48.621844 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.621849 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.621990 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.622122 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:04:48.623836 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.624966 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.626648 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.627299 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.627470 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.632042 (+ 4572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:04:48.632060 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:04:48.632079 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:04:48.632212 (+ 133us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:04:48.636301 (+ 4089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.637098 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.637109 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.637113 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.637317 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.637732 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.637738 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.637742 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.638215 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:04:48.638567 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.638903 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.639174 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 07:04:48.640534 11925 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:04:48.756737 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 11766
I20260811 07:04:48.780800 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 11937
Aug 11 07:04:48 dist-test-slave-69rg krb5kdc[10948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:04:48.797396 12100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:04:48.781670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34262 (local address 127.30.73.67:33303)
0811 07:04:48.781923 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 07:04:48.781931 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:04:48.781962 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:04:48.782195 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:04:48.782199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:04:48.782280 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:04:48.782371 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:04:48.783763 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.784536 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.785920 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:04:48.786355 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:04:48.786462 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:04:48.791346 (+ 4884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:04:48.791364 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:04:48.791383 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:04:48.791433 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:04:48.794574 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.795370 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.795383 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.795391 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.795555 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:04:48.795925 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:04:48.795928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:04:48.795930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:04:48.796311 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:04:48.796602 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 07:04:48.796925 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 07:04:48.797099 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:04:48.798192 12080 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:04:48.889429 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 11937
I20260811 07:04:48.912720 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 11478
I20260811 07:04:48.914134 11547 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:04:49.035101 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 11478
I20260811 07:04:49.064535 31013 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 07:04:49.412189 31013 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 07:04:49.412544 31013 mini_ranger.cc:66] Stopping Ranger...
I20260811 07:04:49.770551 31013 mini_ranger.cc:68] Stopped Ranger
2026-08-11 07:04:49.771 UTC [10981] LOG: received smart shutdown request
2026-08-11 07:04:49.776 UTC [10981] LOG: background worker "logical replication launcher" (PID 10989) exited with exit code 1
2026-08-11 07:04:49.776 UTC [10984] LOG: shutting down
2026-08-11 07:04:49.917 UTC [10981] LOG: database system is shut down
2026-08-11T07:04:49Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (55986 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:04:50 dist-test-slave-69rg krb5kdc[12152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:04:50 dist-test-slave-69rg krb5kdc[12152](info): set up 2 sockets
Aug 11 07:04:50 dist-test-slave-69rg krb5kdc[12152](info): commencing operation
krb5kdc: starting...
W20260811 07:04:51.344810 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:04:51 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:04:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:04:51Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.73.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.73.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/rangeradmin_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/rangeradmin_127.30.73.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.73.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.73.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/rangerlookup_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/rangerlookup_127.30.73.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.73.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.73.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/HTTP_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/HTTP_127.30.73.84@KRBTEST.COM.keytab.
I20260811 07:04:51.762975 31013 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskgm9MY0/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/postgres -l logfile start
2026-08-11 07:04:54.642 UTC [12188] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 07:04:54.642 UTC [12188] LOG: listening on IPv4 address "127.30.73.84", port 39175
2026-08-11 07:04:54.646 UTC [12188] LOG: listening on Unix socket "/tmp/.s.PGSQL.39175"
2026-08-11 07:04:54.678 UTC [12190] LOG: database system was shut down at 2026-08-11 07:04:52 UTC
2026-08-11 07:04:54.683 UTC [12188] LOG: database system is ready to accept connections
I20260811 07:04:55.755045 31013 mini_postgres.cc:96] Postgres bound to 39175
2026-08-11 07:04:55.778 UTC [12200] FATAL: database "slave" does not exist
127.30.73.84:39175 - accepting connections
I20260811 07:04:55.779242 31013 mini_ranger.cc:161] Starting Ranger...
I20260811 07:04:55.809700 31013 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 07:04:56.378793 31013 mini_ranger.cc:87] Created ranger Postgres database
I20260811 07:04:56.378923 31013 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-admin
2026-08-11 07:04:56,702 [I] DB FLAVOR :POSTGRES
2026-08-11 07:04:56,702 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:04:56,703 [I] Checking connection..
2026-08-11 07:04:56,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 07:04:56,970 [I] Checking connection passed.
2026-08-11 07:04:56,970 [I] --------- Verifying version history table ---------
2026-08-11 07:04:56,970 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:04:57,242 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:04:57,243 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:04:57,486 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:04:57,486 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 07:04:57,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 07:04:57.747 UTC [12276] WARNING: there is no transaction in progress
2026-08-11 07:04:57,755 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 07:04:57,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:04:58,015 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 07:04:58,015 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:04:58,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 07:04:58,285 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 07:04:58,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-69rg.c.gcp-upstream.internal','N') ;"
2026-08-11 07:04:58,817 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:04:59,082 [I] Table x_portal_user does not exist in database ranger
2026-08-11 07:04:59,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:04:59,349 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 07:04:59,349 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:04:59,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:04:59,873 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 07:04:59,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 07:05:00.970 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:00.994 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.019 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.043 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.072 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.105 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.187 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.196 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.212 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.224 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.237 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.254 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.266 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.274 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.282 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:01.291 UTC [12410] WARNING: there is no transaction in progress
2026-08-11 07:05:02,191 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 07:05:02,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 07:05:02,486 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 07:05:02,487 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:05:02,764 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 07:05:02,764 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:05:03,054 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 07:05:03,054 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:05:03,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:05:03,599 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-69rg.c.gcp-upstream.internal';"
2026-08-11 07:05:03,839 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 07:05:03,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 07:05:04,093 [I] DB_PATCHES have already been applied
I20260811 07:05:04.100229 31013 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-admin:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskgm9MY0/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 07:05:04.100338 31013 mini_ranger.cc:193] Using host: 127.30.73.84
I20260811 07:05:04.121711 31013 mini_ranger.cc:227] Ranger admin URL: http://127.30.73.84:39951
Aug 11, 2026 7:05:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:05:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:05:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 7:05:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 7:05:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 7:05:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 7:05:05 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 07:05:05.407397 31013 mini_ranger.cc:160] Time spent starting Ranger: real 9.628s user 0.005s sys 0.053s
Aug 11, 2026 7:05:26 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 7:05:26 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 7:05:26 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 7:05:26 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 7:05:27 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 07:05:27.882781 31013 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.73.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.73.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/rangerkms_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.73.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/rangerkms_127.30.73.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.73.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.73.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.73.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/HTTP_127.30.73.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.73.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/HTTP_127.30.73.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 07:05:28 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431928, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 07:05:28.115192 31013 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 07:05:28.142745 31013 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 07:05:29.190984 31013 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 07:05:29.191133 31013 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-kms
I20260811 07:05:29.191190 31013 mini_ranger_kms.cc:227] Using postgres at 127.30.73.84:39175
2026-08-11 07:05:29,595 [I] DB FLAVOR :POSTGRES
2026-08-11 07:05:29,596 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:05:29,596 [I] Checking connection
2026-08-11 07:05:29,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 07:05:29,870 [I] connection success
2026-08-11 07:05:29,871 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 07:05:29,871 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 07:05:29,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 07:05:30,121 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 07:05:30,122 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:05:30,122 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 07:05:30,122 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.73.84:39175/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 07:05:30,425 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 07:05:31.109226 31013 mini_ranger_kms.cc:310] Created kms service
I20260811 07:05:31.355996 31013 mini_ranger_kms.cc:326] Created kudu user
I20260811 07:05:31.405143 31013 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 07:05:31 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431928, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:31.820480 31013 mini_ranger_kms.cc:384] Added ranger policy
I20260811 07:05:31.820930 31013 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-kms:/tmp/dist-test-taskgm9MY0/build/asan/bin/postgresql.jar:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskgm9MY0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 07:05:31.821007 31013 mini_ranger_kms.cc:240] Using host: 127.30.73.84
I20260811 07:05:31.848616 31013 mini_ranger_kms.cc:276] Ranger KMS PID: 12624
I20260811 07:05:31.848771 31013 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.73.84:51261
Aug 11, 2026 7:05:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:05:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:05:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 7:05:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 7:05:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 7:05:33 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 07:05:34 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431934, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.73.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:34.465957 31013 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.351s user 0.079s sys 0.359s
I20260811 07:05:34.466223 31013 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 07:05:34.466405 31013 mini_ranger_kms.cc:401] 127.30.73.84:51261/kms/v1/keys
Aug 11 07:05:34 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431934, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.73.84@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
Aug 11 07:05:34 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431934, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.73.84@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
Aug 11 07:05:37 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:05:37.457439 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36311
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:36311
--ranger_config_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:51261/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:05:37.809070 12678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:37.809366 12678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:37.809523 12678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:37.816991 12678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:05:37.817094 12678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:37.817168 12678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:37.817261 12678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:05:37.817371 12678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:05:37.827739 12678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.73.84:51261/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:36311
--ranger_config_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:37.829043 12678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:37.830500 12678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:37.843518 12685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:37.843459 12684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:37.843428 12687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:37.844100 12678 server_base.cc:1034] running on GCE node
I20260811 07:05:37.845073 12678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:37.846632 12678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:37.848004 12678 hybrid_clock.cc:648] HybridClock initialized: now 1786431937847983 us; error 51 us; skew 500 ppm
I20260811 07:05:37.848865 12678 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:37 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431937, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:37.860337 12678 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:05:37.863528 12678 webserver.cc:460] Webserver started at http://127.30.73.126:34205/ using document root <none> and password file <none>
I20260811 07:05:37.864473 12678 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:37.864651 12678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:37.865054 12678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:05:37 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431937, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:37.939685 12678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "d8c5cfbd24e84ad983ec1a36233e072c"
format_stamp: "Formatted at 2026-08-11 07:05:37 on dist-test-slave-69rg"
server_key: "caeae2cc4809b51909193a5257b0270c"
server_key_iv: "0430514fc9dce81fa16dde4de5e922e3"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:37.940629 12678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "d8c5cfbd24e84ad983ec1a36233e072c"
format_stamp: "Formatted at 2026-08-11 07:05:37 on dist-test-slave-69rg"
server_key: "caeae2cc4809b51909193a5257b0270c"
server_key_iv: "0430514fc9dce81fa16dde4de5e922e3"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:37.946425 12678 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 07:05:37.967365 12695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:37.969012 12678 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:05:37.969221 12678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "d8c5cfbd24e84ad983ec1a36233e072c"
format_stamp: "Formatted at 2026-08-11 07:05:37 on dist-test-slave-69rg"
server_key: "caeae2cc4809b51909193a5257b0270c"
server_key_iv: "0430514fc9dce81fa16dde4de5e922e3"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:37.969560 12678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:37.984297 12678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:37.988539 12678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:37.988906 12678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:38.010082 12678 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:36311
I20260811 07:05:38.010082 12752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:36311 every 8 connection(s)
I20260811 07:05:38.011674 12678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:05:38.016307 12754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:38.020926 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 12678
I20260811 07:05:38.021154 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:05:38.022068 31013 external_mini_cluster.cc:1428] Setting key e0c0c8e662239f33233310787d9a0d26
I20260811 07:05:38.029651 12754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Bootstrap starting.
I20260811 07:05:38.033200 12754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:38.034466 12754 log.cc:824] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:05:38 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:38.037943 12754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: No bootstrap required, opened a new log
I20260811 07:05:38.046469 12754 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } }
I20260811 07:05:38.046890 12754 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:38.046983 12757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:38.024637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37634 (local address 127.30.73.126:36311)
0811 07:05:38.026458 (+ 1821us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:38.026471 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:38.026519 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:05:38.028314 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:38.028339 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:38.028859 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:38.029402 (+ 543us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:38.030831 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:38.032180 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:38.033624 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:38.034413 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:38.034622 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:38.039112 (+ 4490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:38.039120 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:38.039135 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:38.039179 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:38.042718 (+ 3539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:38.043526 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:38.043533 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:38.043539 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:38.043699 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:38.044126 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:38.044133 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:38.044135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:38.044713 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:38.045038 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:38.045523 (+ 485us) server_negotiation.cc:299] Negotiation successful
0811 07:05:38.045969 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1584,"thread_start_us":1334,"threads_started":1}
I20260811 07:05:38.047026 12754 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c5cfbd24e84ad983ec1a36233e072c, State: Initialized, Role: FOLLOWER
I20260811 07:05:38.047747 12754 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } }
I20260811 07:05:38.048040 12754 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:05:38.048192 12754 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:05:38.048394 12754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:38.050957 12754 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } }
I20260811 07:05:38.051407 12754 leader_election.cc:302] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8c5cfbd24e84ad983ec1a36233e072c; no voters:
I20260811 07:05:38.051947 12754 leader_election.cc:288] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:05:38.052192 12759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:05:38.053085 12759 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 1 LEADER]: Becoming Leader. State: Replica: d8c5cfbd24e84ad983ec1a36233e072c, State: Running, Role: LEADER
I20260811 07:05:38.053858 12759 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } }
I20260811 07:05:38.054252 12754 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:05:38.057420 12761 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } } }
I20260811 07:05:38.057966 12761 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:38.058952 12770 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:05:38.068413 12770 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:05:38.072163 12762 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8c5cfbd24e84ad983ec1a36233e072c. Latest consensus state: current_term: 1 leader_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } } }
I20260811 07:05:38.074029 12762 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:38.090687 12770 catalog_manager.cc:1347] Generated new cluster ID: aa6d690270d7419bb4eaa55818427b19
I20260811 07:05:38.090827 12770 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:05:38.091159 12754 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:05:38.121515 12770 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:05:38.123732 12770 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:05:38.137214 12770 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Generated new TSK 0
I20260811 07:05:38.138594 12770 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:05:38.910889 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:51261/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36311
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:05:39 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431939, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 07:05:39.397382 12805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:39.397981 12805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:39.398273 12805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:39.410086 12805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:39.410341 12805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:39.410585 12805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:05:39.428329 12805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.73.84:51261/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36311
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:39.430362 12805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:39.431838 12805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:39.450318 12818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:39.450477 12816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:39.450814 12815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:39.451764 12805 server_base.cc:1034] running on GCE node
I20260811 07:05:39.452498 12805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:39.453665 12805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:39.454885 12805 hybrid_clock.cc:648] HybridClock initialized: now 1786431939454831 us; error 59 us; skew 500 ppm
I20260811 07:05:39.455282 12805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:39 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431939, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:39.459829 12805 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:05:39.468895 12805 webserver.cc:460] Webserver started at http://127.30.73.65:33361/ using document root <none> and password file <none>
I20260811 07:05:39.470023 12805 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:39.470296 12805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:39.470798 12805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:05:39 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431939, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:39.493610 12805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "8182dbeb3f3d46f69c46f902bb074226"
format_stamp: "Formatted at 2026-08-11 07:05:39 on dist-test-slave-69rg"
server_key: "e03eb0b6c33d1c1be2df58ada152dd8f"
server_key_iv: "e4a9ad22ec83ca18c264c7c2da7f1ab6"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:39.495091 12805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "8182dbeb3f3d46f69c46f902bb074226"
format_stamp: "Formatted at 2026-08-11 07:05:39 on dist-test-slave-69rg"
server_key: "e03eb0b6c33d1c1be2df58ada152dd8f"
server_key_iv: "e4a9ad22ec83ca18c264c7c2da7f1ab6"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:39.504498 12805 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.001s
I20260811 07:05:39.532645 12828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:39.534838 12805 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.005s sys 0.004s
I20260811 07:05:39.535179 12805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "8182dbeb3f3d46f69c46f902bb074226"
format_stamp: "Formatted at 2026-08-11 07:05:39 on dist-test-slave-69rg"
server_key: "e03eb0b6c33d1c1be2df58ada152dd8f"
server_key_iv: "e4a9ad22ec83ca18c264c7c2da7f1ab6"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:39.535835 12805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:39.621989 12805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:39.627595 12805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:39.628037 12805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:39.650329 12805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:05:39.658828 12805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:05:39.659034 12805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 07:05:39.659269 12805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:05:39.659404 12805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:05:39 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431939, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:39.931262 12805 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:35747
I20260811 07:05:39.931285 12958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:35747 every 8 connection(s)
I20260811 07:05:39.933001 12805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:05:39.937361 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 12805
I20260811 07:05:39.937559 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:05:39.938408 31013 external_mini_cluster.cc:1428] Setting key ca149a9ce9173631c8f572878b78f7a5
Aug 11 07:05:39 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431939, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:39.987897 12963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:39.939577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:34875 (local address 127.30.73.126:36311)
0811 07:05:39.964100 (+ 24523us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:39.964107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:39.964129 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:05:39.964196 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:39.964201 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:39.964297 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:39.964414 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:39.970067 (+ 5653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:39.971269 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:39.973858 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:39.974472 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:39.974575 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:39.979890 (+ 5315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:39.979899 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:39.979905 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:39.979954 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:39.983803 (+ 3849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:39.984860 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:39.984867 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:39.984871 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:39.985048 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:39.985622 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:39.985627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:39.985631 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:39.986046 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:39.986288 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:39.987268 (+ 980us) server_negotiation.cc:299] Negotiation successful
0811 07:05:39.987505 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24382,"thread_start_us":25769,"threads_started":1}
I20260811 07:05:39.989586 12962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:39.936572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36311 (local address 127.30.73.65:34875)
0811 07:05:39.960566 (+ 23994us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:39.960631 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:39.963295 (+ 2664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:39.965770 (+ 2475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:39.965783 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:39.968261 (+ 2478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:39.969144 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:39.969184 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:39.971498 (+ 2314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:39.971504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:39.973642 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:39.973657 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:39.975339 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:39.975346 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:39.975647 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:39.976514 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:39.976545 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:39.979572 (+ 3027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:39.984041 (+ 4469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:39.984051 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:39.984071 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:39.984672 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:39.985200 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:39.985205 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:39.985209 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:39.985472 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:39.986208 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:39.986220 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:39.986756 (+ 536us) client_negotiation.cc:769] Sending connection context
0811 07:05:39.987123 (+ 367us) client_negotiation.cc:240] Negotiation successful
0811 07:05:39.987717 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23602,"thread_start_us":27863,"threads_started":1}
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
I20260811 07:05:39.991730 12959 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36311
I20260811 07:05:39.992075 12959 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:39.992875 12959 heartbeater.cc:511] Master 127.30.73.126:36311 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
I20260811 07:05:39.998056 12715 ts_manager.cc:194] Registered new tserver with Master: 8182dbeb3f3d46f69c46f902bb074226 (127.30.73.65:35747)
I20260811 07:05:40.000347 12715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:34875
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:05:40.038612 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:51261/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36311
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:05:40 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431939, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
W20260811 07:05:40.518052 12966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:40.518402 12966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:40.518582 12966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:40.525924 12966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:40.526098 12966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:40.526309 12966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:05:40.536871 12966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.73.84:51261/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36311
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:40.538376 12966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:40.539785 12966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:40.554059 12983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:40.554016 12984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:40.554291 12986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:40.554903 12966 server_base.cc:1034] running on GCE node
I20260811 07:05:40.555631 12966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:40.556627 12966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:40.557934 12966 hybrid_clock.cc:648] HybridClock initialized: now 1786431940557866 us; error 53 us; skew 500 ppm
I20260811 07:05:40.558291 12966 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:40 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431940, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:40.561575 12966 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:05:40.563180 12966 webserver.cc:460] Webserver started at http://127.30.73.66:43169/ using document root <none> and password file <none>
I20260811 07:05:40.563887 12966 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:40.564038 12966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:40.564373 12966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:05:40 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431940, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:40.581915 12966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "99b26a9755234a2d8b06c2fbcd4ae231"
format_stamp: "Formatted at 2026-08-11 07:05:40 on dist-test-slave-69rg"
server_key: "fc466b1c3020d205c4876ff02031d7dc"
server_key_iv: "3953a5251aa040c2edd8732fd432cca7"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:40.583089 12966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "99b26a9755234a2d8b06c2fbcd4ae231"
format_stamp: "Formatted at 2026-08-11 07:05:40 on dist-test-slave-69rg"
server_key: "fc466b1c3020d205c4876ff02031d7dc"
server_key_iv: "3953a5251aa040c2edd8732fd432cca7"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:40.590476 12966 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260811 07:05:40.609459 12996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:40.611339 12966 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:05:40.611542 12966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "99b26a9755234a2d8b06c2fbcd4ae231"
format_stamp: "Formatted at 2026-08-11 07:05:40 on dist-test-slave-69rg"
server_key: "fc466b1c3020d205c4876ff02031d7dc"
server_key_iv: "3953a5251aa040c2edd8732fd432cca7"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:40.611822 12966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:40.646726 12966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:40.651120 12966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:40.651470 12966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:40.652834 12966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:05:40.654529 12966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:05:40.654605 12966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:40.654778 12966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:05:40.654830 12966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:40.695477 12966 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:41097
I20260811 07:05:40.695514 13128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:41097 every 8 connection(s)
I20260811 07:05:40.696786 12966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:05:40.699805 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 12966
I20260811 07:05:40.700006 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:05:40.700513 31013 external_mini_cluster.cc:1428] Setting key d66c41361a0af82feead45da0a1bfdf6
Aug 11 07:05:40 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431940, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:40.718024 13131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:40.699502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:59403 (local address 127.30.73.126:36311)
0811 07:05:40.700113 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:40.700120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:40.701094 (+ 974us) server_negotiation.cc:407] Connection header received
0811 07:05:40.702968 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:40.702974 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:40.703078 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:40.703209 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:40.704620 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:40.705383 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:40.707042 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:40.707453 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:40.707590 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:40.711009 (+ 3419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:40.711016 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:40.711019 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:40.711051 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:40.713797 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:40.714895 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:40.714901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:40.714904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:40.715125 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:40.715675 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:40.715678 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:40.715680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:40.716138 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:40.716300 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:40.717182 (+ 882us) server_negotiation.cc:299] Negotiation successful
0811 07:05:40.717460 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":309,"threads_started":1}
I20260811 07:05:40.718844 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:40.700024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36311 (local address 127.30.73.66:59403)
0811 07:05:40.700898 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:40.700960 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:40.702700 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:40.703449 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:40.703456 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:40.703888 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:40.704452 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:40.704468 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:40.705553 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:40.705557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:40.706886 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:40.706906 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:40.707705 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:40.707713 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:40.707945 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:40.708649 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:40.708673 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:40.710783 (+ 2110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:40.713999 (+ 3216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:40.714008 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:40.714043 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:40.714725 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:40.715254 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:40.715260 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:40.715264 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:40.715551 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:40.716274 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:40.716280 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:40.716735 (+ 455us) client_negotiation.cc:769] Sending connection context
0811 07:05:40.717007 (+ 272us) client_negotiation.cc:240] Negotiation successful
0811 07:05:40.717507 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":393,"threads_started":1}
I20260811 07:05:40.720474 13129 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36311
I20260811 07:05:40.720824 13129 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:40.721609 13129 heartbeater.cc:511] Master 127.30.73.126:36311 requested a full tablet report, sending...
I20260811 07:05:40.723501 12715 ts_manager.cc:194] Registered new tserver with Master: 99b26a9755234a2d8b06c2fbcd4ae231 (127.30.73.66:41097)
I20260811 07:05:40.724840 12715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:59403
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:05:40.770049 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:51261/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36311
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:05:41.004467 12959 heartbeater.cc:503] Master 127.30.73.126:36311 was elected leader, sending a full tablet report...
W20260811 07:05:41.140362 13136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:41.140698 13136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:41.140875 13136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:41.148085 13136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:41.148262 13136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:41.148433 13136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:05:41.158974 13136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.73.84:51261/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36311
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:41.160436 13136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:41.161876 13136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:41.176250 13142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:41.176265 13141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:41.176318 13144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:41.177527 13136 server_base.cc:1034] running on GCE node
I20260811 07:05:41.178313 13136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:41.179303 13136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:41.180532 13136 hybrid_clock.cc:648] HybridClock initialized: now 1786431941180464 us; error 87 us; skew 500 ppm
I20260811 07:05:41.180871 13136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:41 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431941, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:41.184413 13136 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:05:41.186115 13136 webserver.cc:460] Webserver started at http://127.30.73.67:38855/ using document root <none> and password file <none>
I20260811 07:05:41.186862 13136 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:41.186990 13136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:41.187278 13136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:05:41 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431941, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:41.205318 13136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "3ba0f527b483498bbffd55addaa646d9"
format_stamp: "Formatted at 2026-08-11 07:05:41 on dist-test-slave-69rg"
server_key: "064862f2793c276f55e9e7566fee913a"
server_key_iv: "72647c37919a4219be32c3e4f9dc4a64"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:41.206377 13136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "3ba0f527b483498bbffd55addaa646d9"
format_stamp: "Formatted at 2026-08-11 07:05:41 on dist-test-slave-69rg"
server_key: "064862f2793c276f55e9e7566fee913a"
server_key_iv: "72647c37919a4219be32c3e4f9dc4a64"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:41.212775 13136 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 07:05:41.230865 13153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:41.232798 13136 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:05:41.233014 13136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "3ba0f527b483498bbffd55addaa646d9"
format_stamp: "Formatted at 2026-08-11 07:05:41 on dist-test-slave-69rg"
server_key: "064862f2793c276f55e9e7566fee913a"
server_key_iv: "72647c37919a4219be32c3e4f9dc4a64"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:41.233290 13136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:41.256393 13136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:41.261592 13136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:41.261992 13136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:41.263128 13136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:05:41.264588 13136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:05:41.264665 13136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:41.264845 13136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:05:41.264909 13136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:41.301178 13136 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:39965
I20260811 07:05:41.301219 13281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:39965 every 8 connection(s)
I20260811 07:05:41.302664 13136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:05:41.312915 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 13136
I20260811 07:05:41.313158 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:05:41.313663 31013 external_mini_cluster.cc:1428] Setting key 2c6248d853160d457fc3cd7c45c4bb10
Aug 11 07:05:41 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431941, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:41.325091 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:41.305549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:59421 (local address 127.30.73.126:36311)
0811 07:05:41.306221 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:41.306226 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:41.306982 (+ 756us) server_negotiation.cc:407] Connection header received
0811 07:05:41.308954 (+ 1972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:41.308960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:41.309072 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:41.309206 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:41.311139 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.311954 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.313781 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.314359 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.314508 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:41.318251 (+ 3743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:41.318257 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:41.318260 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:41.318296 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:41.321495 (+ 3199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:41.322493 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:41.322499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:41.322502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:41.322652 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:41.323144 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:41.323149 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:41.323152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:41.323466 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:41.323655 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:41.324401 (+ 746us) server_negotiation.cc:299] Negotiation successful
0811 07:05:41.324699 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":332,"threads_started":1}
I20260811 07:05:41.326191 13287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:41.306034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36311 (local address 127.30.73.67:59421)
0811 07:05:41.306786 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:41.306840 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:41.308608 (+ 1768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:41.309586 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:41.309596 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:41.310232 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:41.310928 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:41.310949 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.312124 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.312137 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:41.313610 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:41.313624 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.314612 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.314622 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:41.314877 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:41.315624 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:41.315651 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:41.317965 (+ 2314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:41.321725 (+ 3760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:41.321734 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:41.321752 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:41.322338 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:41.322776 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:41.322781 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:41.322792 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:41.323001 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:41.323632 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:41.323641 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:41.324012 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 07:05:41.324299 (+ 287us) client_negotiation.cc:240] Negotiation successful
0811 07:05:41.324913 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":324,"threads_started":1}
I20260811 07:05:41.327816 13282 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36311
I20260811 07:05:41.328186 13282 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:41.328948 13282 heartbeater.cc:511] Master 127.30.73.126:36311 requested a full tablet report, sending...
I20260811 07:05:41.330684 12715 ts_manager.cc:194] Registered new tserver with Master: 3ba0f527b483498bbffd55addaa646d9 (127.30.73.67:39965)
I20260811 07:05:41.331548 12715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:59421
I20260811 07:05:41.342440 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:05:41.344561 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 12805
Aug 11 07:05:41 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:05:41.364744 13289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:41.345686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53490 (local address 127.30.73.65:35747)
0811 07:05:41.346476 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:41.346484 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:41.346512 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:05:41.346572 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:41.346583 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:41.346808 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:41.346945 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:41.348560 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.349708 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.351370 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.351964 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.352090 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:41.358537 (+ 6447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:41.358555 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:41.358573 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:41.358617 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:41.361577 (+ 2960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:41.362636 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:41.362650 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:41.362652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:41.362824 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:41.363232 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:41.363244 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:41.363247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:41.363654 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:41.363917 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:41.364214 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 07:05:41.364428 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":463,"threads_started":1}
I20260811 07:05:41.366199 12952 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:41.450029 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 12805
I20260811 07:05:41.472172 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 12966
Aug 11 07:05:41 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:05:41.490142 13291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:41.473356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54750 (local address 127.30.73.66:41097)
0811 07:05:41.473980 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:41.473988 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:41.474015 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:05:41.474100 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:41.474110 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:41.474433 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:41.474626 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:41.476060 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.477057 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.478666 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.479304 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.479408 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:41.484155 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:41.484170 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:41.484186 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:41.484225 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:41.487273 (+ 3048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:41.487921 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:41.487929 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:41.487931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:41.488085 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:41.488498 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:41.488503 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:41.488505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:41.488893 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:41.489144 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:41.489413 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 07:05:41.489623 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":288,"threads_started":1}
I20260811 07:05:41.491621 13123 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:41.577198 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 12966
I20260811 07:05:41.603260 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 13136
Aug 11 07:05:41 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:05:41.622270 13293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:41.604389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47726 (local address 127.30.73.67:39965)
0811 07:05:41.605087 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:41.605095 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:41.605125 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:05:41.605189 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:41.605196 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:41.605439 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:41.605572 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:41.607374 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.608468 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.610110 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:41.610727 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:41.610841 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:41.615614 (+ 4773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:41.615629 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:41.615646 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:41.615725 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:41.619005 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:41.619898 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:41.619906 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:41.619908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:41.620055 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:41.620552 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:41.620556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:41.620558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:41.620956 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:41.621277 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:41.621619 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 07:05:41.621938 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":373,"threads_started":1}
I20260811 07:05:41.623651 13275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:41.708659 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 13136
I20260811 07:05:41.728852 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 12678
I20260811 07:05:41.730314 12747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:41.841926 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 12678
I20260811 07:05:41.868813 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36311
--webserver_interface=127.30.73.126
--webserver_port=34205
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:36311
--ranger_config_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:51261/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.73.84:51261/kms with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:05:42.224016 13296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:42.224368 13296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:42.224551 13296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:42.232259 13296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:05:42.232378 13296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:42.232474 13296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:42.232581 13296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:05:42.232656 13296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:05:42.243995 13296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.73.84:51261/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:36311
--ranger_config_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=34205
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:42.245464 13296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:42.246946 13296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:42.260471 13302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:42.260551 13303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:42.260512 13305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:42.261888 13296 server_base.cc:1034] running on GCE node
I20260811 07:05:42.262809 13296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:42.264605 13296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:42.265936 13296 hybrid_clock.cc:648] HybridClock initialized: now 1786431942265895 us; error 65 us; skew 500 ppm
I20260811 07:05:42.266356 13296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:42 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431942, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:42.269738 13296 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:05:42.271461 13296 webserver.cc:460] Webserver started at http://127.30.73.126:34205/ using document root <none> and password file <none>
I20260811 07:05:42.272104 13296 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:42.272224 13296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:05:42 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431942, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:42.364869 13296 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:05:42.368453 13316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:42.370282 13296 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:05:42.370528 13296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "d8c5cfbd24e84ad983ec1a36233e072c"
format_stamp: "Formatted at 2026-08-11 07:05:37 on dist-test-slave-69rg"
server_key: "caeae2cc4809b51909193a5257b0270c"
server_key_iv: "0430514fc9dce81fa16dde4de5e922e3"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:42.371690 13296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:42.393263 13296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:42.397778 13296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:42.398172 13296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:42.418721 13296 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:36311
I20260811 07:05:42.418762 13371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:36311 every 8 connection(s)
I20260811 07:05:42.420288 13296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:05:42.421181 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 13296
I20260811 07:05:42.422320 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:51261/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:35747
--local_ip_for_outbound_sockets=127.30.73.65
--tserver_master_addrs=127.30.73.126:36311
--webserver_port=33361
--webserver_interface=127.30.73.65
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.73.84:51261/kms with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:05:42.428090 13372 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:05:42.431517 13372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Bootstrap starting.
I20260811 07:05:42.454620 13372 log.cc:824] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:42.463904 13372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:05:42.464488 13372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Bootstrap complete.
I20260811 07:05:42.476235 13372 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } }
I20260811 07:05:42.477254 13372 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c5cfbd24e84ad983ec1a36233e072c, State: Initialized, Role: FOLLOWER
I20260811 07:05:42.478040 13372 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } }
I20260811 07:05:42.478323 13372 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:05:42.478446 13372 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:05:42.478652 13372 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:05:42.482652 13372 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } }
I20260811 07:05:42.483180 13372 leader_election.cc:302] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8c5cfbd24e84ad983ec1a36233e072c; no voters:
I20260811 07:05:42.483872 13372 leader_election.cc:288] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:05:42.484009 13376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:05:42.485400 13376 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [term 2 LEADER]: Becoming Leader. State: Replica: d8c5cfbd24e84ad983ec1a36233e072c, State: Running, Role: LEADER
I20260811 07:05:42.486075 13376 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } }
I20260811 07:05:42.486333 13372 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:05:42.488940 13378 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8c5cfbd24e84ad983ec1a36233e072c. Latest consensus state: current_term: 2 leader_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } } }
I20260811 07:05:42.489400 13378 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:42.490041 13377 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c5cfbd24e84ad983ec1a36233e072c" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36311 } } }
I20260811 07:05:42.490345 13377 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:42.499342 13385 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:05:42.505336 13385 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:05:42.506898 13385 catalog_manager.cc:1259] Loaded cluster ID: aa6d690270d7419bb4eaa55818427b19
I20260811 07:05:42.507058 13385 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:05:42.511171 13385 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:05:42.512739 13385 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Loaded TSK: 0
I20260811 07:05:42.514415 13385 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:05:42.519524 13372 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260811 07:05:42.877375 13374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:42.877804 13374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:42.878057 13374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:42.889921 13374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:42.890126 13374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:42.890372 13374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:05:42.906528 13374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.73.84:51261/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:35747
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=33361
--tserver_master_addrs=127.30.73.126:36311
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:42.908432 13374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:42.910264 13374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:42.944700 13415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:42.946467 13416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:42.950803 13418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:42.952419 13374 server_base.cc:1034] running on GCE node
I20260811 07:05:42.953418 13374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:42.956826 13374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:42.964699 13374 hybrid_clock.cc:648] HybridClock initialized: now 1786431942964584 us; error 106 us; skew 500 ppm
I20260811 07:05:42.965201 13374 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:42 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431942, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:42.974774 13374 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:05:42.978612 13374 webserver.cc:460] Webserver started at http://127.30.73.65:33361/ using document root <none> and password file <none>
I20260811 07:05:42.979696 13374 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:42.979887 13374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:05:42 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431942, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:43.026008 13374 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.001s sys 0.004s
I20260811 07:05:43.038729 13429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:43.040694 13374 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.003s sys 0.002s
I20260811 07:05:43.040925 13374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "8182dbeb3f3d46f69c46f902bb074226"
format_stamp: "Formatted at 2026-08-11 07:05:39 on dist-test-slave-69rg"
server_key: "e03eb0b6c33d1c1be2df58ada152dd8f"
server_key_iv: "e4a9ad22ec83ca18c264c7c2da7f1ab6"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:43.042418 13374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:43.105687 13374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:43.110674 13374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:43.110988 13374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:43.112167 13374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:05:43.113708 13374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:05:43.113830 13374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:43.113988 13374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:05:43.114100 13374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:43.180301 13374 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:35747
I20260811 07:05:43.180337 13555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:35747 every 8 connection(s)
I20260811 07:05:43.182432 13374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:05:43.192564 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 13374
I20260811 07:05:43.193516 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:51261/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:41097
--local_ip_for_outbound_sockets=127.30.73.66
--tserver_master_addrs=127.30.73.126:36311
--webserver_port=43169
--webserver_interface=127.30.73.66
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.73.84:51261/kms with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:05:43 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431942, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:43.213734 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:43.186111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36311 (local address 127.30.73.65:47653)
0811 07:05:43.187373 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:43.187419 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:43.190147 (+ 2728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:43.191633 (+ 1486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:43.191643 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:43.192326 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:43.192956 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:43.192982 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:43.194943 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:43.194951 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:43.196165 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:43.196178 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:43.197994 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:43.198002 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:43.198307 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:43.199272 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:43.199303 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:43.202866 (+ 3563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:43.208902 (+ 6036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:43.208912 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:43.208935 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:43.209475 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:43.210149 (+ 674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:43.210155 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:43.210159 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:43.210464 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:43.211369 (+ 905us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:43.211379 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:43.211871 (+ 492us) client_negotiation.cc:769] Sending connection context
0811 07:05:43.212203 (+ 332us) client_negotiation.cc:240] Negotiation successful
0811 07:05:43.212686 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":991,"thread_start_us":549,"threads_started":1}
I20260811 07:05:43.215740 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:43.186026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:47653 (local address 127.30.73.126:36311)
0811 07:05:43.186972 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:43.186995 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:43.187563 (+ 568us) server_negotiation.cc:407] Connection header received
0811 07:05:43.190770 (+ 3207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:43.190783 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:43.191126 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:43.191496 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:43.193179 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:43.194771 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:43.196329 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:43.197387 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:43.197568 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:43.203265 (+ 5697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:43.203280 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:43.203305 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:43.203374 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:43.208701 (+ 5327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:43.209668 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:43.209679 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:43.209687 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:43.209970 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:43.210610 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:43.210616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:43.210619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:43.211204 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:43.211429 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:43.214172 (+ 2743us) server_negotiation.cc:299] Negotiation successful
0811 07:05:43.214538 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":337,"threads_started":1}
I20260811 07:05:43.219658 13556 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36311
I20260811 07:05:43.220000 13556 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:43.220767 13556 heartbeater.cc:511] Master 127.30.73.126:36311 requested a full tablet report, sending...
W20260811 07:05:43.223688 13556 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:36311 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:05:43.224082 13556 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:43.224445 13556 heartbeater.cc:511] Master 127.30.73.126:36311 requested a full tablet report, sending...
I20260811 07:05:43.225796 13556 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:43.226125 13556 heartbeater.cc:511] Master 127.30.73.126:36311 requested a full tablet report, sending...
W20260811 07:05:43.227260 13556 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:05:43.694522 13561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:43.694809 13561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:43.694972 13561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:43.704363 13561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:43.704511 13561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:43.704752 13561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:05:43.718411 13561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.73.84:51261/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:41097
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=43169
--tserver_master_addrs=127.30.73.126:36311
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:43.720474 13561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:43.722368 13561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:43.739881 13579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:43.741226 13577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:43.744014 13581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:43.744778 13561 server_base.cc:1034] running on GCE node
I20260811 07:05:43.745496 13561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:43.746690 13561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:43.747992 13561 hybrid_clock.cc:648] HybridClock initialized: now 1786431943747924 us; error 59 us; skew 500 ppm
I20260811 07:05:43.748411 13561 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:43 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431943, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:43.752604 13561 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:05:43.775774 13561 webserver.cc:460] Webserver started at http://127.30.73.66:43169/ using document root <none> and password file <none>
I20260811 07:05:43.777215 13561 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:43.777513 13561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:05:43 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431943, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:43.811013 13561 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.004s sys 0.004s
I20260811 07:05:43.815006 13592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:43.816844 13561 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:05:43.817067 13561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "99b26a9755234a2d8b06c2fbcd4ae231"
format_stamp: "Formatted at 2026-08-11 07:05:40 on dist-test-slave-69rg"
server_key: "fc466b1c3020d205c4876ff02031d7dc"
server_key_iv: "3953a5251aa040c2edd8732fd432cca7"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:43.818662 13561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:43.850556 13561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:43.855355 13561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:43.855664 13561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:43.856825 13561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
Aug 11 07:05:43 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431943, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:43.861709 13561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:05:43.861856 13561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:43.862020 13561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:05:43.862118 13561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:43.934082 13561 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:41097
I20260811 07:05:43.934129 13718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:41097 every 8 connection(s)
I20260811 07:05:43.935868 13561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:05:43.946216 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 13561
I20260811 07:05:43.947093 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.73.84:51261/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:39965
--local_ip_for_outbound_sockets=127.30.73.67
--tserver_master_addrs=127.30.73.126:36311
--webserver_port=38855
--webserver_interface=127.30.73.67
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.73.84:51261/kms with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:05:43 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431943, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:43.963887 13723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:43.939547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36311 (local address 127.30.73.66:51187)
0811 07:05:43.940376 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:43.940429 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:43.942837 (+ 2408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:43.943733 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:43.943745 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:43.944426 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:43.945264 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:43.945294 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:43.946974 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:43.946989 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:43.949172 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:43.949190 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:43.950446 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:43.950454 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:43.950761 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:43.951609 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:43.951643 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:43.954509 (+ 2866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:43.958842 (+ 4333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:43.958853 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:43.958877 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:43.959583 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:43.960091 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:43.960096 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:43.960099 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:43.960333 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:43.961097 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:43.961104 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:43.961467 (+ 363us) client_negotiation.cc:769] Sending connection context
0811 07:05:43.961762 (+ 295us) client_negotiation.cc:240] Negotiation successful
0811 07:05:43.962409 (+ 647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":294,"threads_started":1}
I20260811 07:05:43.967958 13721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:43.938889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:51187 (local address 127.30.73.126:36311)
0811 07:05:43.939590 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:43.939597 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:43.940576 (+ 979us) server_negotiation.cc:407] Connection header received
0811 07:05:43.943189 (+ 2613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:43.943196 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:43.943294 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:43.943429 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:43.945483 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:43.946623 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:43.949377 (+ 2754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:43.950141 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:43.950305 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:43.954796 (+ 4491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:43.954802 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:43.954805 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:43.954844 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:43.958646 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:43.959761 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:43.959767 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:43.959771 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:43.959944 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:43.960472 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:43.960479 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:43.960482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:43.960877 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:43.961019 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:43.961904 (+ 885us) server_negotiation.cc:299] Negotiation successful
0811 07:05:43.967655 (+ 5751us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":420,"threads_started":1}
I20260811 07:05:43.969373 13719 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36311
I20260811 07:05:43.969744 13719 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:43.970726 13719 heartbeater.cc:511] Master 127.30.73.126:36311 requested a full tablet report, sending...
I20260811 07:05:43.972846 13334 ts_manager.cc:194] Registered new tserver with Master: 99b26a9755234a2d8b06c2fbcd4ae231 (127.30.73.66:41097)
I20260811 07:05:43.975099 13334 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:51187
I20260811 07:05:44.227455 13556 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:44.227963 13556 heartbeater.cc:511] Master 127.30.73.126:36311 requested a full tablet report, sending...
I20260811 07:05:44.242846 13334 ts_manager.cc:194] Registered new tserver with Master: 8182dbeb3f3d46f69c46f902bb074226 (127.30.73.65:35747)
I20260811 07:05:44.244247 13334 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:47653
Aug 11 07:05:44 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431943, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
W20260811 07:05:44.386107 13724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:44.386734 13724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:44.386952 13724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:44.398452 13724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:44.398633 13724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:44.398859 13724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:05:44.413371 13724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.73.84:51261/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:39965
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=38855
--tserver_master_addrs=127.30.73.126:36311
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:44.415169 13724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:44.417088 13724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:44.453910 13732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:44.459087 13737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:44.460049 13731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:44.461127 13724 server_base.cc:1034] running on GCE node
I20260811 07:05:44.462199 13724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:44.469398 13724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:44.470714 13724 hybrid_clock.cc:648] HybridClock initialized: now 1786431944470640 us; error 74 us; skew 500 ppm
I20260811 07:05:44.471186 13724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:44 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431944, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:44.475148 13724 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:05:44.514226 13724 webserver.cc:460] Webserver started at http://127.30.73.67:38855/ using document root <none> and password file <none>
I20260811 07:05:44.515141 13724 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:44.515349 13724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:05:44 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431944, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:44.542088 13724 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.001s
I20260811 07:05:44.546141 13744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:44.548192 13724 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:05:44.548460 13724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "3ba0f527b483498bbffd55addaa646d9"
format_stamp: "Formatted at 2026-08-11 07:05:41 on dist-test-slave-69rg"
server_key: "064862f2793c276f55e9e7566fee913a"
server_key_iv: "72647c37919a4219be32c3e4f9dc4a64"
server_key_version: "kuduclusterkey@0"
I20260811 07:05:44.550163 13724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:44.570097 13724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:44.575665 13724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:44.576185 13724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:44.577602 13724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:05:44.579550 13724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:05:44.579720 13724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 07:05:44.579871 13724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:05:44.579996 13724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:44.671100 13724 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:39965
I20260811 07:05:44.672230 13869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:39965 every 8 connection(s)
I20260811 07:05:44.672989 13724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
Aug 11 07:05:44 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431943, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for HTTP/127.30.73.84@KRBTEST.COM
I20260811 07:05:44.682551 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 13724
Aug 11 07:05:44 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431944, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:44.731858 13872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.677696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36311 (local address 127.30.73.67:52245)
0811 07:05:44.705218 (+ 27522us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:44.705284 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:44.707762 (+ 2478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:44.708945 (+ 1183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:44.708958 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:44.709631 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:44.710516 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:44.710543 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.712155 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.712161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:44.714210 (+ 2049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:44.714274 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.717239 (+ 2965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.717249 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:44.717580 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.719027 (+ 1447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:44.719071 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:44.722032 (+ 2961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:44.726722 (+ 4690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:44.726736 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:44.726756 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:44.727392 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:44.727863 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:44.727869 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:44.727873 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:44.728172 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:44.728914 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:44.728924 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:44.729411 (+ 487us) client_negotiation.cc:769] Sending connection context
0811 07:05:44.729739 (+ 328us) client_negotiation.cc:240] Negotiation successful
0811 07:05:44.730379 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27165,"thread_start_us":26899,"threads_started":1}
I20260811 07:05:44.733174 13873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.678098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:52245 (local address 127.30.73.126:36311)
0811 07:05:44.691808 (+ 13710us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:44.691819 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:44.705749 (+ 13930us) server_negotiation.cc:407] Connection header received
0811 07:05:44.708229 (+ 2480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:44.708235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:44.708342 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:44.708445 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:44.710795 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.711915 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.714443 (+ 2528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.715137 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.715260 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.722368 (+ 7108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:44.722375 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:44.722382 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:44.722446 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:44.726544 (+ 4098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:44.727567 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:44.727573 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:44.727576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:44.727716 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:44.728306 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:44.728313 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:44.728321 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:44.728683 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:44.728836 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:44.732390 (+ 3554us) server_negotiation.cc:299] Negotiation successful
0811 07:05:44.732635 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13506,"thread_start_us":14480,"threads_started":1}
I20260811 07:05:44.735292 13870 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36311
I20260811 07:05:44.735647 13870 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:44.736536 13875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.683857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48000 (local address 127.30.73.126:36311)
0811 07:05:44.693079 (+ 9222us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:44.693085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:44.693105 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:05:44.693180 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:44.693188 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:44.693301 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:44.693412 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:44.714003 (+ 20591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.715279 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.716890 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.717649 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.717784 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.721643 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:44.721651 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:44.721658 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:44.721700 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:44.727176 (+ 5476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:44.728178 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:44.728182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:44.728185 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:44.728390 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:44.729768 (+ 1378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:44.729772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:44.729776 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:44.730124 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:44.734798 (+ 4674us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:44.734930 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 07:05:44.735149 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9102,"spinlock_wait_cycles":1280,"thread_start_us":8968,"threads_started":1}
I20260811 07:05:44.736625 13870 heartbeater.cc:511] Master 127.30.73.126:36311 requested a full tablet report, sending...
I20260811 07:05:44.739795 13333 ts_manager.cc:194] Registered new tserver with Master: 3ba0f527b483498bbffd55addaa646d9 (127.30.73.67:39965)
I20260811 07:05:44.740797 13333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:52245
I20260811 07:05:44.754693 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:05:44.848940 13875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.799533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48010 (local address 127.30.73.126:36311)
0811 07:05:44.799772 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:44.799779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:44.819596 (+ 19817us) server_negotiation.cc:407] Connection header received
0811 07:05:44.819804 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:44.819811 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:44.819932 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:44.820058 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:44.832355 (+ 12297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.833511 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.835610 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.836325 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.836474 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.840405 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:44.840412 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:44.840417 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:44.840464 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:44.844147 (+ 3683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:44.845121 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:44.845127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:44.845130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:44.845309 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:44.845797 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:44.845806 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:44.845832 (+ 26us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:44.846216 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:44.846492 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:44.847480 (+ 988us) server_negotiation.cc:299] Negotiation successful
0811 07:05:44.848480 (+ 1000us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:05:44.855988 13333 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48010:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:05:44.875774 13333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:05:44.965797 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.919702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:41097 (local address 127.0.0.1:54760)
0811 07:05:44.943577 (+ 23875us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:44.943621 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:44.943878 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:44.949545 (+ 5667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:44.949553 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:44.949588 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:44.950044 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:44.950060 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.952386 (+ 2326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.952391 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:44.962386 (+ 9995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:44.962412 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.964775 (+ 2363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.964781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:44.965004 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.965078 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 07:05:44.965209 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 07:05:44.965421 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23603,"thread_start_us":36016,"threads_started":1}
I20260811 07:05:44.968104 13889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.923193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47736 (local address 127.30.73.67:39965)
0811 07:05:44.938946 (+ 15753us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:44.938961 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:44.955556 (+ 16595us) server_negotiation.cc:407] Connection header received
0811 07:05:44.956493 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:44.956503 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:44.956775 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:44.956951 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:44.957893 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.959517 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.963694 (+ 4177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.965245 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.965360 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.965613 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:44.967570 (+ 1957us) server_negotiation.cc:299] Negotiation successful
0811 07:05:44.967773 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15489,"thread_start_us":15753,"threads_started":1}
I20260811 07:05:44.968364 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.919840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54760 (local address 127.30.73.66:41097)
0811 07:05:44.948630 (+ 28790us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:44.948639 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:44.948670 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:05:44.948794 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:44.948803 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:44.949056 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:44.949255 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:44.950449 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.952139 (+ 1690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.962620 (+ 10481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.964175 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.964322 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.964577 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:44.967863 (+ 3286us) server_negotiation.cc:299] Negotiation successful
0811 07:05:44.968046 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28613,"thread_start_us":30346,"threads_started":1}
I20260811 07:05:44.969401 13890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.922940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:39965 (local address 127.0.0.1:47736)
0811 07:05:44.955425 (+ 32485us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:44.955447 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:44.956290 (+ 843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:44.957307 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:44.957312 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:44.957338 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:44.957640 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:44.957650 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.960078 (+ 2428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.960084 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:44.963470 (+ 3386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:44.963487 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.967157 (+ 3670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.967164 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:44.967344 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.967381 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:05:44.968857 (+ 1476us) client_negotiation.cc:240] Negotiation successful
0811 07:05:44.969006 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32351,"mutex_wait_us":1,"thread_start_us":21149,"threads_started":1}
I20260811 07:05:44.971591 13891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.945248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53500 (local address 127.30.73.65:35747)
0811 07:05:44.954864 (+ 9616us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:44.954877 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:44.956165 (+ 1288us) server_negotiation.cc:407] Connection header received
0811 07:05:44.958089 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:44.958099 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:44.958318 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:44.958492 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:44.959556 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.961147 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.968585 (+ 7438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.970164 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.970277 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.970485 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:44.971099 (+ 614us) server_negotiation.cc:299] Negotiation successful
0811 07:05:44.971271 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9412,"thread_start_us":9272,"threads_started":1}
I20260811 07:05:44.972505 13886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:44.945036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35747 (local address 127.0.0.1:53500)
0811 07:05:44.955986 (+ 10950us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:44.956004 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:44.957875 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:44.958805 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:44.958809 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:44.958835 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:44.959199 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:44.959212 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.961332 (+ 2120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.961337 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:44.967067 (+ 5730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:44.967087 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:44.970678 (+ 3591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:44.970683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:44.970882 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:44.970913 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:05:44.972028 (+ 1115us) client_negotiation.cc:240] Negotiation successful
0811 07:05:44.972162 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10817,"mutex_wait_us":3475,"thread_start_us":14299,"threads_started":1}
I20260811 07:05:44.973999 13795 tablet_service.cc:1467] Processing CreateTablet for tablet fbb7bcdb0d8b42fb8146ecd58e4a9223 (DEFAULT_TABLE table=test-table [id=b54d416807ab4f23a30b52f7b47bbecf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:05:44.975697 13795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb7bcdb0d8b42fb8146ecd58e4a9223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:44.977231 13487 tablet_service.cc:1467] Processing CreateTablet for tablet fbb7bcdb0d8b42fb8146ecd58e4a9223 (DEFAULT_TABLE table=test-table [id=b54d416807ab4f23a30b52f7b47bbecf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:05:44.977254 13647 tablet_service.cc:1467] Processing CreateTablet for tablet fbb7bcdb0d8b42fb8146ecd58e4a9223 (DEFAULT_TABLE table=test-table [id=b54d416807ab4f23a30b52f7b47bbecf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:05:44.978479 13487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb7bcdb0d8b42fb8146ecd58e4a9223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:44.978667 13647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbb7bcdb0d8b42fb8146ecd58e4a9223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:44.980605 13719 heartbeater.cc:503] Master 127.30.73.126:36311 was elected leader, sending a full tablet report...
I20260811 07:05:44.998127 13892 tablet_bootstrap.cc:492] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: Bootstrap starting.
I20260811 07:05:45.000886 13893 tablet_bootstrap.cc:492] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: Bootstrap starting.
I20260811 07:05:45.001402 13894 tablet_bootstrap.cc:492] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: Bootstrap starting.
I20260811 07:05:45.003376 13892 tablet_bootstrap.cc:654] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:45.004752 13892 log.cc:824] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:45.004971 13893 tablet_bootstrap.cc:654] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:45.006376 13893 log.cc:824] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:45.007798 13894 tablet_bootstrap.cc:654] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:45.009574 13894 log.cc:824] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:45.015332 13892 tablet_bootstrap.cc:492] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: No bootstrap required, opened a new log
I20260811 07:05:45.016052 13892 ts_tablet_manager.cc:1397] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.003s
I20260811 07:05:45.024739 13893 tablet_bootstrap.cc:492] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: No bootstrap required, opened a new log
I20260811 07:05:45.025082 13893 ts_tablet_manager.cc:1397] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.000s
I20260811 07:05:45.035801 13892 raft_consensus.cc:348] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } }
I20260811 07:05:45.035897 13893 raft_consensus.cc:348] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } }
I20260811 07:05:45.036343 13893 raft_consensus.cc:374] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:45.036504 13892 raft_consensus.cc:374] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:45.036518 13893 raft_consensus.cc:729] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8182dbeb3f3d46f69c46f902bb074226, State: Initialized, Role: FOLLOWER
I20260811 07:05:45.036669 13892 raft_consensus.cc:729] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba0f527b483498bbffd55addaa646d9, State: Initialized, Role: FOLLOWER
I20260811 07:05:45.036980 13894 tablet_bootstrap.cc:492] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: No bootstrap required, opened a new log
I20260811 07:05:45.037354 13894 ts_tablet_manager.cc:1397] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: Time spent bootstrapping tablet: real 0.036s user 0.016s sys 0.011s
I20260811 07:05:45.037369 13892 consensus_queue.cc:260] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } }
I20260811 07:05:45.037407 13893 consensus_queue.cc:260] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } }
I20260811 07:05:45.042976 13893 ts_tablet_manager.cc:1428] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
I20260811 07:05:45.043404 13556 heartbeater.cc:503] Master 127.30.73.126:36311 was elected leader, sending a full tablet report...
I20260811 07:05:45.047253 13870 heartbeater.cc:503] Master 127.30.73.126:36311 was elected leader, sending a full tablet report...
I20260811 07:05:45.049389 13892 ts_tablet_manager.cc:1428] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: Time spent starting tablet: real 0.033s user 0.018s sys 0.004s
I20260811 07:05:45.051262 13894 raft_consensus.cc:348] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } }
I20260811 07:05:45.051789 13894 raft_consensus.cc:374] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:45.051921 13894 raft_consensus.cc:729] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b26a9755234a2d8b06c2fbcd4ae231, State: Initialized, Role: FOLLOWER
I20260811 07:05:45.052518 13894 consensus_queue.cc:260] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } }
I20260811 07:05:45.054208 13894 ts_tablet_manager.cc:1428] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: Time spent starting tablet: real 0.017s user 0.016s sys 0.000s
I20260811 07:05:45.138973 13906 raft_consensus.cc:482] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:05:45.139346 13906 raft_consensus.cc:504] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } }
I20260811 07:05:45.141099 13906 leader_election.cc:288] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99b26a9755234a2d8b06c2fbcd4ae231 (127.30.73.66:41097), 8182dbeb3f3d46f69c46f902bb074226 (127.30.73.65:35747)
I20260811 07:05:45.147843 13872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:45.141671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:41097 (local address 127.30.73.67:48747)
0811 07:05:45.142034 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:45.142056 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:45.142251 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:45.142617 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:45.142621 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:45.142650 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:45.142877 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:45.142887 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.144033 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.144038 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:45.145430 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:45.145444 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.147134 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.147143 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:45.147312 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:45.147340 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:05:45.147454 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 07:05:45.147579 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":40,"spinlock_wait_cycles":26496}
I20260811 07:05:45.147922 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:45.141600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:48747 (local address 127.30.73.66:41097)
0811 07:05:45.141874 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:45.141881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:45.142152 (+ 271us) server_negotiation.cc:407] Connection header received
0811 07:05:45.142421 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:45.142425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:45.142486 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:45.142582 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:45.143020 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.143863 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.145641 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.146895 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.147070 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:45.147147 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:45.147514 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 07:05:45.147671 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:05:45.149009 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:45.141740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35747 (local address 127.30.73.67:46763)
0811 07:05:45.142494 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:45.142509 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:45.142745 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:45.143091 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:45.143096 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:45.143119 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:45.143466 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:45.143474 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.144527 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.144532 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:45.146516 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:45.146528 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.148363 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.148367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:45.148484 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:45.148505 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:05:45.148630 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 07:05:45.148731 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":28,"spinlock_wait_cycles":22272,"thread_start_us":425,"threads_started":1}
I20260811 07:05:45.149046 13891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:45.141781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:46763 (local address 127.30.73.65:35747)
0811 07:05:45.141994 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:45.142000 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:45.142614 (+ 614us) server_negotiation.cc:407] Connection header received
0811 07:05:45.142897 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:45.142909 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:45.142970 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:45.143078 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:45.143674 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.144375 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.146719 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.147945 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.148111 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:45.148202 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:45.148669 (+ 467us) server_negotiation.cc:299] Negotiation successful
0811 07:05:45.148807 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:05:45.148976 13670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb7bcdb0d8b42fb8146ecd58e4a9223" candidate_uuid: "3ba0f527b483498bbffd55addaa646d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" is_pre_election: true
I20260811 07:05:45.149629 13670 raft_consensus.cc:2454] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba0f527b483498bbffd55addaa646d9 in term 0.
I20260811 07:05:45.150450 13748 leader_election.cc:302] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba0f527b483498bbffd55addaa646d9, 99b26a9755234a2d8b06c2fbcd4ae231; no voters:
I20260811 07:05:45.150367 13507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb7bcdb0d8b42fb8146ecd58e4a9223" candidate_uuid: "3ba0f527b483498bbffd55addaa646d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8182dbeb3f3d46f69c46f902bb074226" is_pre_election: true
I20260811 07:05:45.150895 13906 raft_consensus.cc:2781] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:05:45.150928 13507 raft_consensus.cc:2454] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba0f527b483498bbffd55addaa646d9 in term 0.
I20260811 07:05:45.151052 13906 raft_consensus.cc:482] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:05:45.151178 13906 raft_consensus.cc:3037] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:45.153555 13906 raft_consensus.cc:504] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } }
I20260811 07:05:45.154214 13906 leader_election.cc:288] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [CANDIDATE]: Term 1 election: Requested vote from peers 99b26a9755234a2d8b06c2fbcd4ae231 (127.30.73.66:41097), 8182dbeb3f3d46f69c46f902bb074226 (127.30.73.65:35747)
I20260811 07:05:45.154712 13507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb7bcdb0d8b42fb8146ecd58e4a9223" candidate_uuid: "3ba0f527b483498bbffd55addaa646d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8182dbeb3f3d46f69c46f902bb074226"
I20260811 07:05:45.154702 13670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbb7bcdb0d8b42fb8146ecd58e4a9223" candidate_uuid: "3ba0f527b483498bbffd55addaa646d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99b26a9755234a2d8b06c2fbcd4ae231"
I20260811 07:05:45.154922 13507 raft_consensus.cc:3037] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:45.154947 13670 raft_consensus.cc:3037] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:45.157505 13507 raft_consensus.cc:2454] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba0f527b483498bbffd55addaa646d9 in term 1.
I20260811 07:05:45.157507 13670 raft_consensus.cc:2454] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba0f527b483498bbffd55addaa646d9 in term 1.
I20260811 07:05:45.157994 13748 leader_election.cc:302] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba0f527b483498bbffd55addaa646d9, 99b26a9755234a2d8b06c2fbcd4ae231; no voters:
I20260811 07:05:45.158285 13906 raft_consensus.cc:2781] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:05:45.158689 13906 raft_consensus.cc:686] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 1 LEADER]: Becoming Leader. State: Replica: 3ba0f527b483498bbffd55addaa646d9, State: Running, Role: LEADER
I20260811 07:05:45.159158 13906 consensus_queue.cc:237] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } }
I20260811 07:05:45.166754 13333 catalog_manager.cc:5495] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ba0f527b483498bbffd55addaa646d9 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "3ba0f527b483498bbffd55addaa646d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ba0f527b483498bbffd55addaa646d9" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 39965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 } health_report { overall_health: UNKNOWN } } }
W20260811 07:05:45.188814 13557 tablet.cc:2369] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:05:45.188977 13720 tablet.cc:2369] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:05:45.204806 13871 tablet.cc:2369] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:05:45.216368 13889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:45.206390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47748 (local address 127.30.73.67:39965)
0811 07:05:45.206833 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:45.206840 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:45.207016 (+ 176us) server_negotiation.cc:407] Connection header received
0811 07:05:45.207423 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:45.207428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:45.207559 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:45.207802 (+ 243us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:05:45.208483 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.209770 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.212392 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.213116 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.213495 (+ 379us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:45.214479 (+ 984us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:05:45.215379 (+ 900us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:05:45.215657 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:45.215792 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 07:05:45.215931 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 07:05:45.232133 13507 raft_consensus.cc:1261] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [term 1 FOLLOWER]: Refusing update from remote peer 3ba0f527b483498bbffd55addaa646d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:05:45.232133 13670 raft_consensus.cc:1261] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [term 1 FOLLOWER]: Refusing update from remote peer 3ba0f527b483498bbffd55addaa646d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:05:45.234936 13910 consensus_queue.cc:1035] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99b26a9755234a2d8b06c2fbcd4ae231" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 41097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 07:05:45.235877 13906 consensus_queue.cc:1035] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8182dbeb3f3d46f69c46f902bb074226" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:05:45.262126 13915 mvcc.cc:205] Tried to move back new op lower bound from 7317225247650922496 to 7317225247375835136. Current Snapshot: MvccSnapshot[applied={T|T < 7317225247650922496}]
I20260811 07:05:45.294839 13334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:05:45.295506 13334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:05:45.303330 13334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8c5cfbd24e84ad983ec1a36233e072c: Sending DeleteTablet for 3 replicas of tablet fbb7bcdb0d8b42fb8146ecd58e4a9223
I20260811 07:05:45.305604 13647 tablet_service.cc:1514] Processing DeleteTablet for tablet fbb7bcdb0d8b42fb8146ecd58e4a9223 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:05:45 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:54760
I20260811 07:05:45.306433 13795 tablet_service.cc:1514] Processing DeleteTablet for tablet fbb7bcdb0d8b42fb8146ecd58e4a9223 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:05:45 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:47736
I20260811 07:05:45.306399 13487 tablet_service.cc:1514] Processing DeleteTablet for tablet fbb7bcdb0d8b42fb8146ecd58e4a9223 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:05:45 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:53500
I20260811 07:05:45.315234 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 13374
I20260811 07:05:45.317047 13930 tablet_replica.cc:330] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: stopping tablet replica
I20260811 07:05:45.318188 13930 raft_consensus.cc:2229] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:05:45.319617 13930 raft_consensus.cc:2258] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:05:45.322353 13929 tablet_replica.cc:330] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: stopping tablet replica
I20260811 07:05:45.323470 13929 raft_consensus.cc:2229] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:05:45.324923 13930 ts_tablet_manager.cc:1905] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:05:45.325663 13929 raft_consensus.cc:2258] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:05:45.327528 13928 tablet_replica.cc:330] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: stopping tablet replica
I20260811 07:05:45.328413 13928 raft_consensus.cc:2229] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:05:45.329556 13928 raft_consensus.cc:2258] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:05:45.331321 13929 ts_tablet_manager.cc:1905] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:05:45.334964 13928 ts_tablet_manager.cc:1905] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:05:45.339609 13930 ts_tablet_manager.cc:1918] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:05:45.340066 13930 log.cc:1196] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/fbb7bcdb0d8b42fb8146ecd58e4a9223
I20260811 07:05:45.341150 13930 ts_tablet_manager.cc:1939] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 8182dbeb3f3d46f69c46f902bb074226: Deleting consensus metadata
I20260811 07:05:45.345062 13318 catalog_manager.cc:4841] TS 8182dbeb3f3d46f69c46f902bb074226 (127.30.73.65:35747): tablet fbb7bcdb0d8b42fb8146ecd58e4a9223 (table test-table [id=b54d416807ab4f23a30b52f7b47bbecf]) successfully deleted
I20260811 07:05:45.347708 13929 ts_tablet_manager.cc:1918] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:05:45.348073 13929 log.cc:1196] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/fbb7bcdb0d8b42fb8146ecd58e4a9223
I20260811 07:05:45.348940 13929 ts_tablet_manager.cc:1939] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 3ba0f527b483498bbffd55addaa646d9: Deleting consensus metadata
I20260811 07:05:45.351822 13928 ts_tablet_manager.cc:1918] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:05:45.351850 13318 catalog_manager.cc:4841] TS 3ba0f527b483498bbffd55addaa646d9 (127.30.73.67:39965): tablet fbb7bcdb0d8b42fb8146ecd58e4a9223 (table test-table [id=b54d416807ab4f23a30b52f7b47bbecf]) successfully deleted
I20260811 07:05:45.352231 13928 log.cc:1196] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/fbb7bcdb0d8b42fb8146ecd58e4a9223
I20260811 07:05:45.353246 13928 ts_tablet_manager.cc:1939] T fbb7bcdb0d8b42fb8146ecd58e4a9223 P 99b26a9755234a2d8b06c2fbcd4ae231: Deleting consensus metadata
I20260811 07:05:45.356453 13320 catalog_manager.cc:4841] TS 99b26a9755234a2d8b06c2fbcd4ae231 (127.30.73.66:41097): tablet fbb7bcdb0d8b42fb8146ecd58e4a9223 (table test-table [id=b54d416807ab4f23a30b52f7b47bbecf]) successfully deleted
I20260811 07:05:45.368870 13891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:45.318038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53512 (local address 127.30.73.65:35747)
0811 07:05:45.318437 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:45.318444 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:45.327951 (+ 9507us) server_negotiation.cc:407] Connection header received
0811 07:05:45.328359 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:45.328376 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:45.328532 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:45.328788 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:45.332282 (+ 3494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.334189 (+ 1907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.346097 (+ 11908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.347322 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.347529 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:45.353217 (+ 5688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:45.353258 (+ 41us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:45.353293 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:45.353506 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:45.361869 (+ 8363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:45.363784 (+ 1915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:45.363810 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:45.363813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:45.364133 (+ 320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:45.364795 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:45.364801 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:45.364804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:45.365983 (+ 1179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:45.366703 (+ 720us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:45.367119 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 07:05:45.367700 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260811 07:05:45.370718 13551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:45.572125 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 13374
I20260811 07:05:45.622686 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 13561
I20260811 07:05:45.663448 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:45.624350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54774 (local address 127.30.73.66:41097)
0811 07:05:45.624801 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:45.624814 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:45.624862 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:05:45.625006 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:45.625012 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:45.625128 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:45.625343 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:45.629434 (+ 4091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.630930 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.636155 (+ 5225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.637422 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.637668 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:45.646111 (+ 8443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:45.646154 (+ 43us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:45.646200 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:45.646298 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:45.654701 (+ 8403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:45.657060 (+ 2359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:45.657080 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:45.657082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:45.657472 (+ 390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:45.658501 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:45.658508 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:45.658510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:45.659799 (+ 1289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:45.660637 (+ 838us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:45.661312 (+ 675us) server_negotiation.cc:299] Negotiation successful
0811 07:05:45.662066 (+ 754us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161}
I20260811 07:05:45.665987 13713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:45.835012 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 13561
I20260811 07:05:45.885895 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 13724
I20260811 07:05:45.917309 13936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:45.887372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47764 (local address 127.30.73.67:39965)
0811 07:05:45.888525 (+ 1153us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:45.888541 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:45.888568 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:05:45.888647 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:45.888650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:45.888760 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:45.888966 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:45.892155 (+ 3189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.894112 (+ 1957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.896693 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:45.897917 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:45.898205 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:45.904557 (+ 6352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:45.904584 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:45.904615 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:45.904693 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:45.911126 (+ 6433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:45.912728 (+ 1602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:45.912739 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:45.912741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:45.913046 (+ 305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:45.914077 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:45.914083 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:45.914085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:45.914978 (+ 893us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:45.915420 (+ 442us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:45.916298 (+ 878us) server_negotiation.cc:299] Negotiation successful
0811 07:05:45.916616 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":959,"thread_start_us":593,"threads_started":1}
I20260811 07:05:45.918411 13865 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:46.094010 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 13724
I20260811 07:05:46.131485 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 13296
I20260811 07:05:46.134052 13367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:46.304065 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 13296
I20260811 07:05:46.366058 31013 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 07:05:46.737180 31013 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 07:05:46.737574 31013 mini_ranger.cc:66] Stopping Ranger...
I20260811 07:05:47.095217 31013 mini_ranger.cc:68] Stopped Ranger
2026-08-11 07:05:47.095 UTC [12188] LOG: received smart shutdown request
2026-08-11 07:05:47.099 UTC [12188] LOG: background worker "logical replication launcher" (PID 12198) exited with exit code 1
2026-08-11 07:05:47.100 UTC [12192] LOG: shutting down
2026-08-11 07:05:47.324 UTC [12188] LOG: database system is shut down
2026-08-11T07:05:47Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (57392 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:05:47 dist-test-slave-69rg krb5kdc[13948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:05:47 dist-test-slave-69rg krb5kdc[13948](info): set up 2 sockets
Aug 11 07:05:47 dist-test-slave-69rg krb5kdc[13948](info): commencing operation
krb5kdc: starting...
W20260811 07:05:48.720098 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:05:48 dist-test-slave-69rg krb5kdc[13948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:05:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:05:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:05:49.026805 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:37053
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:40753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:37053,127.30.73.125:40475,127.30.73.124:36923
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:05:49.386447 13965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:49.386750 13965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:49.386929 13965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:49.394341 13965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:05:49.394459 13965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:49.394543 13965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:49.394660 13965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:05:49.394726 13965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:05:49.405056 13965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:40753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:37053,127.30.73.125:40475,127.30.73.124:36923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:37053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:49.407151 13965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:49.408744 13965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:49.421320 13976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:49.421716 13974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:49.421733 13973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:49.422526 13965 server_base.cc:1034] running on GCE node
I20260811 07:05:49.423444 13965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:49.424957 13965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:49.426208 13965 hybrid_clock.cc:648] HybridClock initialized: now 1786431949426171 us; error 47 us; skew 500 ppm
I20260811 07:05:49.426605 13965 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:49 dist-test-slave-69rg krb5kdc[13948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431949, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:49.434199 13965 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:05:49.436218 13965 webserver.cc:460] Webserver started at http://127.30.73.126:40167/ using document root <none> and password file <none>
I20260811 07:05:49.437018 13965 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:49.437188 13965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:49.437544 13965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:05:49.440891 13965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "a4899e38bea646ff96e9fd13748c1570"
format_stamp: "Formatted at 2026-08-11 07:05:49 on dist-test-slave-69rg"
server_key: "9ccf34afe2873dcd0532da6f689e65cc"
server_key_iv: "0216f6992e41a4beef320e4f7bd1b757"
server_key_version: "encryptionkey@0"
I20260811 07:05:49.441787 13965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "a4899e38bea646ff96e9fd13748c1570"
format_stamp: "Formatted at 2026-08-11 07:05:49 on dist-test-slave-69rg"
server_key: "9ccf34afe2873dcd0532da6f689e65cc"
server_key_iv: "0216f6992e41a4beef320e4f7bd1b757"
server_key_version: "encryptionkey@0"
I20260811 07:05:49.447561 13965 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260811 07:05:49.451638 13984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:49.453199 13965 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:05:49.453424 13965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "a4899e38bea646ff96e9fd13748c1570"
format_stamp: "Formatted at 2026-08-11 07:05:49 on dist-test-slave-69rg"
server_key: "9ccf34afe2873dcd0532da6f689e65cc"
server_key_iv: "0216f6992e41a4beef320e4f7bd1b757"
server_key_version: "encryptionkey@0"
I20260811 07:05:49.453764 13965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:49.475539 13965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:49.480280 13965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:49.480602 13965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:49.501940 13965 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:37053
I20260811 07:05:49.501967 14043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:37053 every 8 connection(s)
I20260811 07:05:49.503404 13965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:05:49.507145 14044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:49.507961 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 13965
I20260811 07:05:49.508240 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:05:49.509160 31013 external_mini_cluster.cc:1428] Setting key b6e51e85c8ad17e72f18f04542b44fe6
I20260811 07:05:49.517580 14044 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:05:49 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431949, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.73.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.125@KRBTEST.COM" created.
I20260811 07:05:49.541749 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.521723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:37053 (local address 127.0.0.1:46896)
0811 07:05:49.522668 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.522716 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:49.524852 (+ 2136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:49.525717 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:49.525724 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:49.526482 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:49.526821 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:49.526838 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:49.528423 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:49.528430 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:49.529531 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:49.529544 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:49.530574 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:49.530581 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:49.530783 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:49.531495 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:49.531517 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:49.533749 (+ 2232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:49.537200 (+ 3451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:49.537211 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:49.537224 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:49.537644 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:49.538161 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:49.538167 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:49.538171 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:49.538342 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:49.539146 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:49.539154 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:49.539416 (+ 262us) client_negotiation.cc:769] Sending connection context
0811 07:05:49.539670 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 07:05:49.540307 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":143,"thread_start_us":365,"threads_started":1}
I20260811 07:05:49.541771 14048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.523149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46896 (local address 127.30.73.126:37053)
0811 07:05:49.523885 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:49.523898 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:49.523960 (+ 62us) server_negotiation.cc:407] Connection header received
0811 07:05:49.525226 (+ 1266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:49.525231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:49.525480 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:49.525717 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:49.527026 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:49.528255 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:49.529698 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:49.530324 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:49.530539 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:49.534026 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:49.534035 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:49.534049 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:49.534078 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:49.537054 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:49.537796 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:49.537802 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:49.537805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:49.538028 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:49.538460 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:49.538464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:49.538468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:49.538993 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:49.539221 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:49.539806 (+ 585us) server_negotiation.cc:299] Negotiation successful
0811 07:05:49.540193 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":332,"threads_started":1}
I20260811 07:05:49.545151 14044 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:05:49.546504 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.545973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36306)
0811 07:05:49.546189 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.546332 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 07:05:49.546835 13989 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
I20260811 07:05:49.548609 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.548102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36320)
0811 07:05:49.548319 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.548416 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 07:05:49.548847 14044 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40475: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab.
Entry for principal kudu/127.30.73.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab.
I20260811 07:05:49.579010 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.125:40475
--webserver_interface=127.30.73.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab
--principal=kudu/127.30.73.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:40753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:37053,127.30.73.125:40475,127.30.73.124:36923
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:05:49.598342 14044 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } attempt: 1
I20260811 07:05:49.599858 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.599213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36334)
0811 07:05:49.599486 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.599657 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 07:05:49.601153 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.600671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36346)
0811 07:05:49.600856 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.600956 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 07:05:49.601392 14044 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40475: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
I20260811 07:05:49.669715 14044 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } attempt: 2
I20260811 07:05:49.671140 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.670553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36362)
0811 07:05:49.670844 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.670959 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 07:05:49.672211 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.671801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36364)
0811 07:05:49.671968 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.672053 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:05:49.672478 14044 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40475: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
I20260811 07:05:49.763790 14044 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } attempt: 3
I20260811 07:05:49.765105 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.764559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36376)
0811 07:05:49.764837 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.764955 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260811 07:05:49.766456 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.766015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36388)
0811 07:05:49.766228 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.766309 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260811 07:05:49.766703 14044 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40475: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
I20260811 07:05:49.909996 14044 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } attempt: 4
I20260811 07:05:49.911384 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.910763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36394)
0811 07:05:49.911128 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.911229 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184}
I20260811 07:05:49.912586 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:49.912189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36396)
0811 07:05:49.912343 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:49.912448 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 07:05:49.912839 14044 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40475: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40475: connect: Connection refused (error 111)
W20260811 07:05:49.926673 14051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:49.927124 14051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:49.927295 14051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:49.934585 14051 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:05:49.934688 14051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:49.934733 14051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:49.934791 14051 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:05:49.934836 14051 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:05:49.944675 14051 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:40753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:37053,127.30.73.125:40475,127.30.73.124:36923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab
--principal=kudu/127.30.73.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.125:40475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.73.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:49.946043 14051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:49.947311 14051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:49.959792 14058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:49.959910 14059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:49.959899 14061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:49.961333 14051 server_base.cc:1034] running on GCE node
I20260811 07:05:49.962208 14051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:49.963694 14051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:49.964900 14051 hybrid_clock.cc:648] HybridClock initialized: now 1786431949964846 us; error 42 us; skew 500 ppm
I20260811 07:05:49.965257 14051 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:49 dist-test-slave-69rg krb5kdc[13948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431949, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:49.968518 14051 init.cc:377] Logged in from keytab as kudu/127.30.73.125@KRBTEST.COM (short username kudu)
I20260811 07:05:49.970191 14051 webserver.cc:460] Webserver started at http://127.30.73.125:43151/ using document root <none> and password file <none>
I20260811 07:05:49.970886 14051 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:49.971019 14051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:49.971352 14051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:05:49.974798 14051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/data/instance:
uuid: "df23c22078304fd9b9d597da7dfcbc4c"
format_stamp: "Formatted at 2026-08-11 07:05:49 on dist-test-slave-69rg"
server_key: "7dd60fb38b194d566a71790fcda7cf24"
server_key_iv: "9da91e61d404216cb1cb2c46579f239e"
server_key_version: "encryptionkey@0"
I20260811 07:05:49.975669 14051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/wal/instance:
uuid: "df23c22078304fd9b9d597da7dfcbc4c"
format_stamp: "Formatted at 2026-08-11 07:05:49 on dist-test-slave-69rg"
server_key: "7dd60fb38b194d566a71790fcda7cf24"
server_key_iv: "9da91e61d404216cb1cb2c46579f239e"
server_key_version: "encryptionkey@0"
I20260811 07:05:49.981115 14051 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 07:05:49.985002 14070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:49.986479 14051 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:05:49.986681 14051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/wal
uuid: "df23c22078304fd9b9d597da7dfcbc4c"
format_stamp: "Formatted at 2026-08-11 07:05:49 on dist-test-slave-69rg"
server_key: "7dd60fb38b194d566a71790fcda7cf24"
server_key_iv: "9da91e61d404216cb1cb2c46579f239e"
server_key_version: "encryptionkey@0"
I20260811 07:05:49.986898 14051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:50.000682 14051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:50.005942 14051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:50.006296 14051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:50.027594 14051 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.125:40475
I20260811 07:05:50.027638 14125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.125:40475 every 8 connection(s)
I20260811 07:05:50.029091 14051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
I20260811 07:05:50.029559 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 14051
I20260811 07:05:50.029798 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-1/wal/instance
I20260811 07:05:50.030429 31013 external_mini_cluster.cc:1428] Setting key 57fc2599a133677c405b5325e78de50e
I20260811 07:05:50.033993 14126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:50.044010 14126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.30.73.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.124@KRBTEST.COM" created.
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431949, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:50.075850 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.047480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:37053 (local address 127.0.0.1:46910)
0811 07:05:50.048374 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.048426 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:50.051375 (+ 2949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:50.052311 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:50.052325 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:50.053204 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:50.054165 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.054194 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.055480 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.055490 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.058118 (+ 2628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.058140 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.059244 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.059254 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.059616 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.060539 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:50.060576 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:50.067895 (+ 7319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:50.071762 (+ 3867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.071772 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.071792 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.072277 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.072685 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.072690 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.072694 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.072890 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.073473 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:50.073481 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:50.073958 (+ 477us) client_negotiation.cc:769] Sending connection context
0811 07:05:50.074366 (+ 408us) client_negotiation.cc:240] Negotiation successful
0811 07:05:50.074789 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":332,"threads_started":1}
I20260811 07:05:50.077157 14129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.046905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46910 (local address 127.30.73.126:37053)
0811 07:05:50.047467 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.047474 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.048590 (+ 1116us) server_negotiation.cc:407] Connection header received
0811 07:05:50.051795 (+ 3205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.051800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.051897 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.052018 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.054422 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.055156 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.058389 (+ 3233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.058870 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.059040 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.068281 (+ 9241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.068291 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.068297 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.068370 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.071579 (+ 3209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.072425 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.072431 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.072441 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.072563 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.073018 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.073023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.073028 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.073325 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.073487 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.076381 (+ 2894us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.076672 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":273,"threads_started":1}
I20260811 07:05:50.078636 14126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431949, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:05:50.095286 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.079549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36400)
0811 07:05:50.079731 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.079752 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:50.079873 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:50.080643 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:50.080647 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:50.081353 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:50.081523 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.081532 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.083176 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.083185 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.084135 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.084147 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.085109 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.085116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.085344 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.086040 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:50.086060 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:50.088659 (+ 2599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:50.092718 (+ 4059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.092726 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.092733 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.093099 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.093488 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.093494 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.093497 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.093641 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.094335 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:50.094346 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:50.094490 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 07:05:50.094690 (+ 200us) client_negotiation.cc:240] Negotiation successful
0811 07:05:50.094930 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 07:05:50.095405 14132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.079652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36400 (local address 127.30.73.125:40475)
0811 07:05:50.080239 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.080245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.080269 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:05:50.080312 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.080318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.080493 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.080652 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.081724 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.083019 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.084297 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.084909 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.085053 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.088898 (+ 3845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.088911 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.088927 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.088964 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.092571 (+ 3607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.093244 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.093258 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.093260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.093381 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.093757 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.093764 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.093767 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.094199 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.094417 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.094856 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.095057 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":274,"threads_started":1}
I20260811 07:05:50.097995 14126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:05:50.099274 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.098778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43420)
0811 07:05:50.098994 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.099115 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260811 07:05:50.099634 14075 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
I20260811 07:05:50.101433 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.101089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43430)
0811 07:05:50.101241 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.101322 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 07:05:50.101737 14126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:36923: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab.
Entry for principal kudu/127.30.73.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab.
I20260811 07:05:50.106721 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.124:36923
--webserver_interface=127.30.73.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab
--principal=kudu/127.30.73.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:40753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:37053,127.30.73.125:40475,127.30.73.124:36923
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:05:50.151154 14126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } attempt: 1
I20260811 07:05:50.152567 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.151995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43434)
0811 07:05:50.152264 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.152391 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260811 07:05:50.153733 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.153331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43436)
0811 07:05:50.153522 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.153607 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 07:05:50.154016 14126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:36923: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
I20260811 07:05:50.212168 14044 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } attempt: 5
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431949, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:05:50.222282 14126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } attempt: 2
I20260811 07:05:50.223379 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.222850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43438)
0811 07:05:50.223046 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.223177 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 07:05:50.224665 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.224110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43452)
0811 07:05:50.224462 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.224536 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 07:05:50.224936 14126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:36923: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
I20260811 07:05:50.228808 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.213111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36410)
0811 07:05:50.213342 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.213367 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:50.213493 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:50.213997 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:50.214001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:50.214444 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:50.214672 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.214684 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.216191 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.216196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.217480 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.217498 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.218627 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.218632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.218822 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.219527 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:50.219549 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:50.222113 (+ 2564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:50.226136 (+ 4023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.226140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.226143 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.226535 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.226967 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.226970 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.226972 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.227108 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.227832 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:50.227836 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:50.227992 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 07:05:50.228141 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 07:05:50.228531 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 07:05:50.228998 14132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.213215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36410 (local address 127.30.73.125:40475)
0811 07:05:50.213420 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.213426 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.213452 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:05:50.213637 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.213642 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.213763 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.213925 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.214866 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.216006 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.217657 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.218430 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.218565 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.222382 (+ 3817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.222389 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.222393 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.222436 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.225999 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.226659 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.226665 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.226668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.226847 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.227229 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.227234 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.227237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.227663 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.227818 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.228385 (+ 567us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.228623 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:05:50.230563 14044 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:05:50.231685 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.231251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43468)
0811 07:05:50.231440 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.231520 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 07:05:50.232723 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.232365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43474)
0811 07:05:50.232526 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.232619 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 07:05:50.233050 14044 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:36923: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
I20260811 07:05:50.284363 14044 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } attempt: 1
I20260811 07:05:50.285835 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.285281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43476)
0811 07:05:50.285520 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.285617 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260811 07:05:50.286942 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.286578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43480)
0811 07:05:50.286743 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.286828 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 07:05:50.287178 14044 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:36923: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
I20260811 07:05:50.316205 14126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } attempt: 3
I20260811 07:05:50.317440 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.316929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43496)
0811 07:05:50.317168 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.317272 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 07:05:50.318588 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.318153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43498)
0811 07:05:50.318378 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.318463 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
W20260811 07:05:50.318809 14126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:36923: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
I20260811 07:05:50.355394 14044 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } attempt: 2
I20260811 07:05:50.356649 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.356079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43512)
0811 07:05:50.356344 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.356441 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 07:05:50.357685 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.357337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43524)
0811 07:05:50.357497 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.357575 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 07:05:50.357996 14044 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:36923: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
I20260811 07:05:50.462064 14126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } attempt: 4
I20260811 07:05:50.463363 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.462839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43530)
0811 07:05:50.463097 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.463184 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 07:05:50.464243 14044 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } attempt: 3
I20260811 07:05:50.464461 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.464056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43544)
0811 07:05:50.464247 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.464323 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 07:05:50.464771 14126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:36923: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
I20260811 07:05:50.465322 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.464812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43552)
0811 07:05:50.465052 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.465143 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 07:05:50.466763 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.466070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43568)
0811 07:05:50.466408 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.466578 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
W20260811 07:05:50.467123 14044 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:36923: Network error: Client connection negotiation failed: client connection to 127.30.73.124:36923: connect: Connection refused (error 111)
W20260811 07:05:50.483647 14134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:50.483946 14134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:50.484092 14134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:50.491714 14134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:05:50.491832 14134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:50.491905 14134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:50.491992 14134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:05:50.492038 14134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:05:50.502506 14134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:40753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:37053,127.30.73.125:40475,127.30.73.124:36923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab
--principal=kudu/127.30.73.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.124:36923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.73.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:50.504251 14134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:50.505909 14134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:50.520766 14144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:50.520769 14142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:50.521034 14141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:50.521456 14134 server_base.cc:1034] running on GCE node
I20260811 07:05:50.522408 14134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:50.523826 14134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:50.525074 14134 hybrid_clock.cc:648] HybridClock initialized: now 1786431950525028 us; error 59 us; skew 500 ppm
I20260811 07:05:50.525451 14134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431950, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:50.528699 14134 init.cc:377] Logged in from keytab as kudu/127.30.73.124@KRBTEST.COM (short username kudu)
I20260811 07:05:50.530359 14134 webserver.cc:460] Webserver started at http://127.30.73.124:43145/ using document root <none> and password file <none>
I20260811 07:05:50.531023 14134 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:50.531121 14134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:50.531371 14134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:05:50.534409 14134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/data/instance:
uuid: "c46d3e6ce3e14a2d82997b3f2bd25216"
format_stamp: "Formatted at 2026-08-11 07:05:50 on dist-test-slave-69rg"
server_key: "46f7c28a48aac2139bc16732b963c4cd"
server_key_iv: "a1a5dfbf2714c173387de4b93ce19c1d"
server_key_version: "encryptionkey@0"
I20260811 07:05:50.535204 14134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/wal/instance:
uuid: "c46d3e6ce3e14a2d82997b3f2bd25216"
format_stamp: "Formatted at 2026-08-11 07:05:50 on dist-test-slave-69rg"
server_key: "46f7c28a48aac2139bc16732b963c4cd"
server_key_iv: "a1a5dfbf2714c173387de4b93ce19c1d"
server_key_version: "encryptionkey@0"
I20260811 07:05:50.540647 14134 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:05:50.544219 14155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:50.545709 14134 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 07:05:50.545928 14134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/wal
uuid: "c46d3e6ce3e14a2d82997b3f2bd25216"
format_stamp: "Formatted at 2026-08-11 07:05:50 on dist-test-slave-69rg"
server_key: "46f7c28a48aac2139bc16732b963c4cd"
server_key_iv: "a1a5dfbf2714c173387de4b93ce19c1d"
server_key_version: "encryptionkey@0"
I20260811 07:05:50.546123 14134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:50.588469 14134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:50.593418 14134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:50.593766 14134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:50.614420 14134 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.124:36923
I20260811 07:05:50.614476 14211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.124:36923 every 8 connection(s)
I20260811 07:05:50.615872 14134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
I20260811 07:05:50.620110 14212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:50.621479 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 14134
I20260811 07:05:50.621694 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786431722204153-31013-0/minicluster-data/master-2/wal/instance
I20260811 07:05:50.622380 31013 external_mini_cluster.cc:1428] Setting key 6cdde8a06280e839b1eb4d189349eee7
I20260811 07:05:50.630553 14212 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431950, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:50.644421 14044 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } attempt: 4
I20260811 07:05:50.649127 14215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.624597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43578 (local address 127.30.73.124:36923)
0811 07:05:50.625463 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.625475 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.625517 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:05:50.627220 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.627244 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.627622 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.627979 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.629917 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.631230 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.633175 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.634379 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.634562 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.639394 (+ 4832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.639402 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.639420 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.639466 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.643415 (+ 3949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.644188 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.644197 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.644206 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.644442 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.644982 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.644991 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.644997 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.645901 (+ 904us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.646265 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.647094 (+ 829us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.647604 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":408,"threads_started":1}
I20260811 07:05:50.651960 14217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.633369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:37053 (local address 127.0.0.1:46920)
0811 07:05:50.634333 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.634378 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:50.634537 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:50.635130 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:50.635136 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:50.636033 (+ 897us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:50.636425 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.636443 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.637540 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.637546 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.638718 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.638730 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.639691 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.639697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.639918 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.640698 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:50.640725 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:50.643549 (+ 2824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:50.648340 (+ 4791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.648351 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.648358 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.648930 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.649417 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.649421 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.649424 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.649598 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.650870 (+ 1272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:50.650878 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:50.651071 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 07:05:50.651256 (+ 185us) client_negotiation.cc:240] Negotiation successful
0811 07:05:50.651593 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"thread_start_us":555,"threads_started":1}
I20260811 07:05:50.653359 14216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.633380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46920 (local address 127.30.73.126:37053)
0811 07:05:50.633986 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.633992 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.634790 (+ 798us) server_negotiation.cc:407] Connection header received
0811 07:05:50.634846 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.634850 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.634924 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.635060 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.636622 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.637372 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.638870 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.639447 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.639542 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.643751 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.643756 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.643759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.643800 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.648191 (+ 4391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.649066 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.649071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.649075 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.649266 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.649758 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.649763 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.649767 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.650236 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.650387 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.651938 (+ 1551us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.652962 (+ 1024us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":278,"threads_started":1}
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431949, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
I20260811 07:05:50.655232 14212 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:05:50.662943 14047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.645095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43588)
0811 07:05:50.645403 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.645424 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:50.645530 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:50.646526 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:50.646533 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:50.647123 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:50.647340 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.647354 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.648649 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.648654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.650217 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.650232 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.651301 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.651307 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.651529 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.652188 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:50.652209 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:50.655103 (+ 2894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:50.659288 (+ 4185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.659293 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.659298 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.659843 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.660813 (+ 970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.660818 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.660823 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.660994 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.661787 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:50.661795 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:50.662017 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 07:05:50.662201 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 07:05:50.662508 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260811 07:05:50.663239 14218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.645258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43588 (local address 127.30.73.124:36923)
0811 07:05:50.646167 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.646171 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.646220 (+ 49us) server_negotiation.cc:407] Connection header received
0811 07:05:50.646270 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.646277 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.646353 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.646462 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.647531 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.648498 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.650360 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.651035 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.651277 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.655339 (+ 4062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.655345 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.655348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.655377 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.659159 (+ 3782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.660525 (+ 1366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.660529 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.660532 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.660694 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.661173 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.661179 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.661183 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.661623 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.661790 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.662417 (+ 627us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.662753 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":780,"spinlock_wait_cycles":42240,"thread_start_us":509,"threads_started":1}
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431950, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:05:50.669979 14044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570: Bootstrap starting.
I20260811 07:05:50.672389 14219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.653526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46936 (local address 127.30.73.126:37053)
0811 07:05:50.654181 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.654187 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.654211 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:05:50.654255 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.654260 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.654327 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.654493 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.656478 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.657590 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.659158 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.659844 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.659971 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.666093 (+ 6122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.666098 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.666102 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.666136 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.669084 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.669935 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.669942 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.669948 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.670143 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.670609 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.670622 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.670624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.671020 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.671313 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.671676 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.671936 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":313,"threads_started":1}
I20260811 07:05:50.672793 14217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.656181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40475 (local address 127.0.0.1:36426)
0811 07:05:50.656466 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.656483 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:50.656604 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:50.656955 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:50.656964 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:50.657457 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:50.657695 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.657707 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.659232 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.659237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.660265 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.660280 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.661356 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.661362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.661623 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.662331 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:50.662353 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:50.665506 (+ 3153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:50.669759 (+ 4253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.669765 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.669768 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.670418 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.670891 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.670896 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.670900 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.671092 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.671799 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:50.671803 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:50.671988 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 07:05:50.672139 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 07:05:50.672438 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":3}
I20260811 07:05:50.673650 14132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.656116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36426 (local address 127.30.73.125:40475)
0811 07:05:50.656326 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.656333 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.656582 (+ 249us) server_negotiation.cc:407] Connection header received
0811 07:05:50.656721 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.656726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.656804 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.656906 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.657931 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.659017 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.660422 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.661189 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.661339 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.665744 (+ 4405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.665751 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.665756 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.665806 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.669579 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.670567 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.670573 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.670576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.670751 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.671238 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.671245 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.671248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.671582 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.671733 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.673174 (+ 1441us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.673342 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:05:50.674494 14044 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:50.674651 14212 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:05:50.676075 14044 log.cc:824] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:50.679840 14044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570: No bootstrap required, opened a new log
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431950, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:05:50.689872 14044 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } }
I20260811 07:05:50.690372 14044 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:50.690510 14044 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4899e38bea646ff96e9fd13748c1570, State: Initialized, Role: FOLLOWER
I20260811 07:05:50.691265 14044 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } }
I20260811 07:05:50.692483 14217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.675353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43600)
0811 07:05:50.675514 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.675534 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:50.675637 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:50.676990 (+ 1353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:50.676994 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:50.677417 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:50.677556 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.677564 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.678907 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.678912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.680171 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.680187 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.681205 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.681215 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.681406 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.682088 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:50.682117 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:50.684990 (+ 2873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:50.688906 (+ 3916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.688911 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.688915 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.689607 (+ 692us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.690154 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.690159 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.690162 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.690336 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.691166 (+ 830us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:50.691171 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:50.691337 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 07:05:50.691525 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 07:05:50.691928 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 07:05:50.692656 14132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.674812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36440 (local address 127.30.73.125:40475)
0811 07:05:50.675246 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.675251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.675269 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:05:50.675319 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.675324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.675394 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.675487 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.677070 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.678175 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.679447 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.679884 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.680032 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.685693 (+ 5661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.685702 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.685708 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.685751 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.689360 (+ 3609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.690318 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.690325 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.690332 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.690500 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.691059 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.691062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.691064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.691406 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.691816 (+ 410us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.692064 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.692311 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298}
I20260811 07:05:50.693780 14218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.675688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43600 (local address 127.30.73.124:36923)
0811 07:05:50.676693 (+ 1005us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.676701 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.676720 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:05:50.676771 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.676776 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.676850 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.676973 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.677710 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.678755 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.680367 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.681009 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.681142 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.685221 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.685230 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.685236 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.685277 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.688738 (+ 3461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.689756 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.689762 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.689767 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.689958 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.690480 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.690488 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.690492 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.690928 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.691074 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.693021 (+ 1947us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.693344 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840}
I20260811 07:05:50.698423 14221 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.698997 14221 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:05:50.699030 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:05:50.699477 14212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216: Bootstrap starting.
I20260811 07:05:50.699919 14044 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:05:50.703111 14212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:50.704316 14212 log.cc:824] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:50.707540 14212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216: No bootstrap required, opened a new log
I20260811 07:05:50.710755 14221 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:05:50.711097 14221 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } }
I20260811 07:05:50.712890 14221 leader_election.cc:288] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df23c22078304fd9b9d597da7dfcbc4c (127.30.73.125:40475), c46d3e6ce3e14a2d82997b3f2bd25216 (127.30.73.124:36923)
I20260811 07:05:50.722445 14212 raft_consensus.cc:348] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } }
I20260811 07:05:50.722882 14212 raft_consensus.cc:374] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:50.723012 14212 raft_consensus.cc:729] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c46d3e6ce3e14a2d82997b3f2bd25216, State: Initialized, Role: FOLLOWER
I20260811 07:05:50.723805 14212 consensus_queue.cc:260] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } }
I20260811 07:05:50.726493 14212 sys_catalog.cc:564] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:05:50.727183 14185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4899e38bea646ff96e9fd13748c1570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" is_pre_election: true
I20260811 07:05:50.727839 14185 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4899e38bea646ff96e9fd13748c1570 in term 0.
I20260811 07:05:50.728713 13989 leader_election.cc:302] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4899e38bea646ff96e9fd13748c1570, c46d3e6ce3e14a2d82997b3f2bd25216; no voters:
I20260811 07:05:50.729197 14221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:05:50.729342 14221 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:05:50.729449 14221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:50.725242 14237 sys_catalog.cc:455] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.730105 14237 sys_catalog.cc:458] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:05:50.733084 14221 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } }
W20260811 07:05:50.733726 13992 tablet.cc:2369] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:05:50.735322 14185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4899e38bea646ff96e9fd13748c1570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216"
I20260811 07:05:50.735562 14185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:50.739216 14185 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4899e38bea646ff96e9fd13748c1570 in term 1.
I20260811 07:05:50.739786 13989 leader_election.cc:302] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4899e38bea646ff96e9fd13748c1570, c46d3e6ce3e14a2d82997b3f2bd25216; no voters:
I20260811 07:05:50.741500 14221 leader_election.cc:288] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [CANDIDATE]: Term 1 election: Requested vote from peers df23c22078304fd9b9d597da7dfcbc4c (127.30.73.125:40475), c46d3e6ce3e14a2d82997b3f2bd25216 (127.30.73.124:36923)
I20260811 07:05:50.742455 14221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:05:50.742899 14221 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [term 1 LEADER]: Becoming Leader. State: Replica: a4899e38bea646ff96e9fd13748c1570, State: Running, Role: LEADER
I20260811 07:05:50.743582 14221 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } }
I20260811 07:05:50.744963 14219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.708975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46946 (local address 127.30.73.126:37053)
0811 07:05:50.709286 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.709295 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.714370 (+ 5075us) server_negotiation.cc:407] Connection header received
0811 07:05:50.714745 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.714750 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.714823 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.714891 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.719368 (+ 4477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.720688 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.723310 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.724075 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.724201 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.731063 (+ 6862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.731073 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.731081 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.731138 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.736108 (+ 4970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.740720 (+ 4612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.740729 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.740736 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.740957 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.741950 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.741959 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.741965 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.742504 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.743232 (+ 728us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.744033 (+ 801us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.744401 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":95}
I20260811 07:05:50.752610 14218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.714535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43606 (local address 127.30.73.124:36923)
0811 07:05:50.714903 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.714909 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.721194 (+ 6285us) server_negotiation.cc:407] Connection header received
0811 07:05:50.723402 (+ 2208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.723411 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.723493 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.723594 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.725777 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.726905 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.731891 (+ 4986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.732564 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.732718 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.740568 (+ 7850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.740576 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.740581 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.740643 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.744501 (+ 3858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.747398 (+ 2897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.747406 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.747409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.747588 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.748887 (+ 1299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.748896 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.748903 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.749450 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.749848 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.751679 (+ 1831us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.752033 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 07:05:50.756976 14132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.708800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36444 (local address 127.30.73.125:40475)
0811 07:05:50.709024 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.709034 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.714419 (+ 5385us) server_negotiation.cc:407] Connection header received
0811 07:05:50.714699 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.714707 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.714791 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.714866 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.719972 (+ 5106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.721087 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.728868 (+ 7781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.729582 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.729691 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.746043 (+ 16352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.746054 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.746063 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.746128 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.751396 (+ 5268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.752945 (+ 1549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.752956 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.752962 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.753209 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.753923 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.753931 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.753937 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.754502 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.754831 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.755745 (+ 914us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.756172 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:05:50.759205 14221 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4899e38bea646ff96e9fd13748c1570. Latest consensus state: current_term: 1 leader_uuid: "a4899e38bea646ff96e9fd13748c1570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.759600 14221 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:50.764072 14126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } attempt: 5
I20260811 07:05:50.764884 14243 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:05:50.772709 14243 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 07:05:50 dist-test-slave-69rg krb5kdc[13948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431949, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
I20260811 07:05:50.787451 14218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.765421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43614 (local address 127.30.73.124:36923)
0811 07:05:50.765621 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:50.765639 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:50.765659 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:05:50.765725 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:50.765733 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:50.765883 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:50.765998 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:50.767676 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.769004 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.771308 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.771992 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.772139 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.780343 (+ 8204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:50.780351 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:50.780356 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:50.780398 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:50.784141 (+ 3743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.784988 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.784996 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.784999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.785168 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:50.785663 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:50.785669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:50.785672 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:50.786138 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:50.786287 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:50.786878 (+ 591us) server_negotiation.cc:299] Negotiation successful
0811 07:05:50.787111 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:05:50.788337 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:50.764800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:36923 (local address 127.0.0.1:43614)
0811 07:05:50.765044 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:50.765065 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:50.765182 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:50.766210 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:50.766215 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:50.766805 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:50.767035 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.767048 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.769189 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.769198 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.771131 (+ 1933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:50.771159 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:50.772276 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:50.772285 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:50.775261 (+ 2976us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:50.776610 (+ 1349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:50.776638 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:50.780096 (+ 3458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:50.784313 (+ 4217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.784318 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.784323 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.784848 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.785328 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:50.785333 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:50.785336 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:50.785516 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:50.786399 (+ 883us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:50.786404 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:50.786576 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 07:05:50.787645 (+ 1069us) client_negotiation.cc:240] Negotiation successful
0811 07:05:50.787957 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 07:05:50.793021 14251 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:05:50.797489 14126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c: Bootstrap starting.
I20260811 07:05:50.799274 14185 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [term 1 FOLLOWER]: Refusing update from remote peer a4899e38bea646ff96e9fd13748c1570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:05:50.810638 14240 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:05:50.799397 13965 master_runner.cc:186] Error getting master registration for 127.30.73.125:40475: OK, instance_id { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" instance_seqno: 1786431950021396 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:05:50.814210 13965 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:05:50.814898 14126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:50.816743 14126 log.cc:824] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:50.828015 14126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c: No bootstrap required, opened a new log
I20260811 07:05:50.830071 14237 sys_catalog.cc:455] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4899e38bea646ff96e9fd13748c1570. Latest consensus state: current_term: 1 leader_uuid: "a4899e38bea646ff96e9fd13748c1570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.830507 14237 sys_catalog.cc:458] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:05:50.833078 14255 mvcc.cc:205] Tried to move back new op lower bound from 7317225270460604416 to 7317225270258597888. Current Snapshot: MvccSnapshot[applied={T|T < 7317225270460604416}]
I20260811 07:05:50.833573 14221 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a4899e38bea646ff96e9fd13748c1570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.833932 14221 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:50.847412 14243 catalog_manager.cc:1347] Generated new cluster ID: fd4880d0579d44b191f37654e3ffb02c
I20260811 07:05:50.847545 14243 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:05:50.858031 14237 sys_catalog.cc:455] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a4899e38bea646ff96e9fd13748c1570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.858386 14237 sys_catalog.cc:458] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:05:50.856910 14126 raft_consensus.cc:348] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } }
I20260811 07:05:50.870277 14126 raft_consensus.cc:374] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:50.870460 14126 raft_consensus.cc:729] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df23c22078304fd9b9d597da7dfcbc4c, State: Initialized, Role: FOLLOWER
I20260811 07:05:50.871387 14126 consensus_queue.cc:260] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } }
I20260811 07:05:50.872747 14266 sys_catalog.cc:455] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.873252 14266 sys_catalog.cc:458] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:05:50.875463 14126 sys_catalog.cc:564] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:05:50.875499 14098 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4899e38bea646ff96e9fd13748c1570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df23c22078304fd9b9d597da7dfcbc4c"
I20260811 07:05:50.876860 14097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:50.876658 14099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a4899e38bea646ff96e9fd13748c1570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df23c22078304fd9b9d597da7dfcbc4c" is_pre_election: true
I20260811 07:05:50.880231 14097 raft_consensus.cc:1261] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [term 1 FOLLOWER]: Refusing update from remote peer a4899e38bea646ff96e9fd13748c1570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:05:50.881057 14240 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:05:50.894667 14243 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:05:50.896601 14243 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:05:50.916720 14243 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570: Generated new TSK 0
I20260811 07:05:50.917943 14243 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:05:50.929946 14266 sys_catalog.cc:455] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4899e38bea646ff96e9fd13748c1570. Latest consensus state: current_term: 1 leader_uuid: "a4899e38bea646ff96e9fd13748c1570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.930510 14266 sys_catalog.cc:458] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:05:50.930053 14279 sys_catalog.cc:455] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a4899e38bea646ff96e9fd13748c1570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.931401 14279 sys_catalog.cc:458] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:05:50.932644 14240 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a4899e38bea646ff96e9fd13748c1570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4899e38bea646ff96e9fd13748c1570" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 37053 } } peers { permanent_uuid: "df23c22078304fd9b9d597da7dfcbc4c" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40475 } } peers { permanent_uuid: "c46d3e6ce3e14a2d82997b3f2bd25216" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 36923 } } }
I20260811 07:05:50.933109 14240 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4899e38bea646ff96e9fd13748c1570 [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:50.942279 14286 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:05:50.943564 14285 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:05:51.948952 14286 catalog_manager.cc:1259] Loaded cluster ID: fd4880d0579d44b191f37654e3ffb02c
I20260811 07:05:51.948954 14285 catalog_manager.cc:1259] Loaded cluster ID: fd4880d0579d44b191f37654e3ffb02c
I20260811 07:05:51.949123 14285 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216: loading cluster ID for follower catalog manager: success
I20260811 07:05:51.949376 14286 catalog_manager.cc:1552] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c: loading cluster ID for follower catalog manager: success
I20260811 07:05:51.954011 14286 catalog_manager.cc:1574] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c: acquiring CA information for follower catalog manager: success
I20260811 07:05:51.954002 14285 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216: acquiring CA information for follower catalog manager: success
I20260811 07:05:51.957082 14286 catalog_manager.cc:1602] T 00000000000000000000000000000000 P df23c22078304fd9b9d597da7dfcbc4c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:05:51.957084 14285 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c46d3e6ce3e14a2d82997b3f2bd25216: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:05:52.034850 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 13965
I20260811 07:05:52.036437 14038 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:52.260541 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 13965
I20260811 07:05:52.306056 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 14051
I20260811 07:05:52.307770 14121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:52.446482 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 14051
I20260811 07:05:52.476056 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 14134
I20260811 07:05:52.477599 14207 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:52.602941 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 14134
2026-08-11T07:05:52Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5127 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:05:52 dist-test-slave-69rg krb5kdc[14300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:05:52 dist-test-slave-69rg krb5kdc[14300](info): set up 2 sockets
Aug 11 07:05:52 dist-test-slave-69rg krb5kdc[14300](info): commencing operation
krb5kdc: starting...
W20260811 07:05:53.823443 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.001s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:05:54 dist-test-slave-69rg krb5kdc[14300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:05:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:05:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:05:54.126511 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:39249
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:39249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:05:54.493788 14317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:54.494195 14317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:54.494378 14317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:54.501915 14317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:05:54.502032 14317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:54.502080 14317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:54.502161 14317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:05:54.502257 14317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:05:54.512569 14317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:39249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:39249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:54.514092 14317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:54.515475 14317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:54.528532 14326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:54.528687 14324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:54.529619 14317 server_base.cc:1034] running on GCE node
W20260811 07:05:54.530193 14322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:54.531396 14317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:54.533154 14317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:54.534392 14317 hybrid_clock.cc:648] HybridClock initialized: now 1786431954534327 us; error 51 us; skew 500 ppm
I20260811 07:05:54.534772 14317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:54 dist-test-slave-69rg krb5kdc[14300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431954, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:54.542289 14317 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:05:54.544039 14317 webserver.cc:460] Webserver started at http://127.30.73.126:41941/ using document root <none> and password file <none>
I20260811 07:05:54.544804 14317 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:54.544970 14317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:54.545313 14317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:05:54.548592 14317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "901b7fcf8f3f478ca5dc7e957cb26316"
format_stamp: "Formatted at 2026-08-11 07:05:54 on dist-test-slave-69rg"
server_key: "3f6e86e1c1f46c553944af7af55d92e6"
server_key_iv: "2bbe9a02ecb2f0e931ea0496bbd20325"
server_key_version: "encryptionkey@0"
I20260811 07:05:54.549453 14317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "901b7fcf8f3f478ca5dc7e957cb26316"
format_stamp: "Formatted at 2026-08-11 07:05:54 on dist-test-slave-69rg"
server_key: "3f6e86e1c1f46c553944af7af55d92e6"
server_key_iv: "2bbe9a02ecb2f0e931ea0496bbd20325"
server_key_version: "encryptionkey@0"
I20260811 07:05:54.555131 14317 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:05:54.559047 14333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:54.560547 14317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:05:54.560776 14317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "901b7fcf8f3f478ca5dc7e957cb26316"
format_stamp: "Formatted at 2026-08-11 07:05:54 on dist-test-slave-69rg"
server_key: "3f6e86e1c1f46c553944af7af55d92e6"
server_key_iv: "2bbe9a02ecb2f0e931ea0496bbd20325"
server_key_version: "encryptionkey@0"
I20260811 07:05:54.561021 14317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:54.575265 14317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:54.580528 14317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:54.580892 14317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:54.601379 14317 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:39249
I20260811 07:05:54.601428 14393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:39249 every 8 connection(s)
I20260811 07:05:54.602948 14317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:05:54.606763 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 14317
I20260811 07:05:54.607028 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:05:54.607354 14394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:54.607846 31013 external_mini_cluster.cc:1428] Setting key 1544accbebde467f136e8550df77b8cc
I20260811 07:05:54.624017 14394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316: Bootstrap starting.
Aug 11 07:05:54 dist-test-slave-69rg krb5kdc[14300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:54.628299 14394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:54.629746 14394 log.cc:824] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:54.633297 14394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316: No bootstrap required, opened a new log
I20260811 07:05:54.634836 14397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:54.609852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42962 (local address 127.30.73.126:39249)
0811 07:05:54.610824 (+ 972us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:54.610843 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:54.610898 (+ 55us) server_negotiation.cc:407] Connection header received
0811 07:05:54.613117 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:54.613148 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:54.613705 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:54.614197 (+ 492us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:54.615661 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:54.617937 (+ 2276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:54.619507 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:54.620783 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:54.620996 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:54.626082 (+ 5086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:54.626091 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:54.626110 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:54.626157 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:54.629978 (+ 3821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:54.630973 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:54.630982 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:54.630991 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:54.631196 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:54.631601 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:54.631607 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:54.631610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:54.632166 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:54.632475 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:54.632953 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 07:05:54.633463 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":410,"threads_started":1}
I20260811 07:05:54.639273 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:05:54.643153 14394 raft_consensus.cc:348] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901b7fcf8f3f478ca5dc7e957cb26316" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 39249 } }
I20260811 07:05:54.643610 14394 raft_consensus.cc:374] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:54.643738 14394 raft_consensus.cc:729] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 901b7fcf8f3f478ca5dc7e957cb26316, State: Initialized, Role: FOLLOWER
I20260811 07:05:54.644438 14394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901b7fcf8f3f478ca5dc7e957cb26316" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 39249 } }
I20260811 07:05:54.644722 14394 raft_consensus.cc:388] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:05:54.644897 14394 raft_consensus.cc:482] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:05:54.645098 14394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:54.647591 14394 raft_consensus.cc:504] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901b7fcf8f3f478ca5dc7e957cb26316" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 39249 } }
I20260811 07:05:54.648140 14394 leader_election.cc:302] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 901b7fcf8f3f478ca5dc7e957cb26316; no voters:
I20260811 07:05:54.648834 14394 leader_election.cc:288] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:05:54.648933 14399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:05:54.649847 14399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [term 1 LEADER]: Becoming Leader. State: Replica: 901b7fcf8f3f478ca5dc7e957cb26316, State: Running, Role: LEADER
I20260811 07:05:54.650400 14399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901b7fcf8f3f478ca5dc7e957cb26316" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 39249 } }
I20260811 07:05:54.651240 14394 sys_catalog.cc:564] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:05:54.653452 14401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 901b7fcf8f3f478ca5dc7e957cb26316. Latest consensus state: current_term: 1 leader_uuid: "901b7fcf8f3f478ca5dc7e957cb26316" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901b7fcf8f3f478ca5dc7e957cb26316" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 39249 } } }
I20260811 07:05:54.653352 14400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "901b7fcf8f3f478ca5dc7e957cb26316" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901b7fcf8f3f478ca5dc7e957cb26316" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 39249 } } }
I20260811 07:05:54.653738 14400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:54.653738 14401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316 [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:54.654590 14404 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:05:54.661022 14404 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:05:54.670351 14404 catalog_manager.cc:1347] Generated new cluster ID: 085e56f448384854bb2cf166c6b46d08
I20260811 07:05:54.670490 14404 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:05:54.688338 14404 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:05:54.689673 14404 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:05:54.700184 14404 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 901b7fcf8f3f478ca5dc7e957cb26316: Generated new TSK 0
I20260811 07:05:54.701038 14404 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:05:54.753001 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 14317
I20260811 07:05:54.754441 14386 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:54.854411 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 14317
2026-08-11T07:05:54Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2239 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:05:54 dist-test-slave-69rg krb5kdc[14424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:05:54 dist-test-slave-69rg krb5kdc[14424](info): set up 2 sockets
Aug 11 07:05:54 dist-test-slave-69rg krb5kdc[14424](info): commencing operation
krb5kdc: starting...
W20260811 07:05:56.051898 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.007s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:05:56 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:05:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:05:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:05:56.370774 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44257
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44257
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:05:56.726475 14441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:56.726876 14441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:56.727038 14441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:56.734666 14441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:05:56.734817 14441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:56.734922 14441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:56.735034 14441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:05:56.735112 14441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:05:56.745298 14441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:56.746804 14441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:56.748193 14441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:56.760315 14449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:56.760351 14447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:56.760403 14446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:56.761864 14441 server_base.cc:1034] running on GCE node
I20260811 07:05:56.762686 14441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:56.764137 14441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:56.765383 14441 hybrid_clock.cc:648] HybridClock initialized: now 1786431956765336 us; error 38 us; skew 500 ppm
I20260811 07:05:56.765754 14441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:56 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431956, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:56.769150 14441 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:05:56.770879 14441 webserver.cc:460] Webserver started at http://127.30.73.126:36755/ using document root <none> and password file <none>
I20260811 07:05:56.771615 14441 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:56.771770 14441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:56.772095 14441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:05:56.775292 14441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "1e3087016853467c8c5655413c39aa70"
format_stamp: "Formatted at 2026-08-11 07:05:56 on dist-test-slave-69rg"
server_key: "149d45b41861ac383d6063cd0ec2a8ff"
server_key_iv: "8977dc852f990519521b418bb03a59b7"
server_key_version: "encryptionkey@0"
I20260811 07:05:56.776086 14441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "1e3087016853467c8c5655413c39aa70"
format_stamp: "Formatted at 2026-08-11 07:05:56 on dist-test-slave-69rg"
server_key: "149d45b41861ac383d6063cd0ec2a8ff"
server_key_iv: "8977dc852f990519521b418bb03a59b7"
server_key_version: "encryptionkey@0"
I20260811 07:05:56.781534 14441 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:05:56.785076 14456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:56.786557 14441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:05:56.786762 14441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "1e3087016853467c8c5655413c39aa70"
format_stamp: "Formatted at 2026-08-11 07:05:56 on dist-test-slave-69rg"
server_key: "149d45b41861ac383d6063cd0ec2a8ff"
server_key_iv: "8977dc852f990519521b418bb03a59b7"
server_key_version: "encryptionkey@0"
I20260811 07:05:56.786965 14441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:56.816787 14441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:56.821487 14441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:56.821831 14441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:56.841706 14441 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:44257
I20260811 07:05:56.841747 14514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:44257 every 8 connection(s)
I20260811 07:05:56.843168 14441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:05:56.846952 14515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:56.852805 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 14441
I20260811 07:05:56.853049 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:05:56.854001 31013 external_mini_cluster.cc:1428] Setting key 3eb76f9e324b8612174a49e724e882d5
I20260811 07:05:56.858848 14515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Bootstrap starting.
I20260811 07:05:56.862865 14515 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:56.864181 14515 log.cc:824] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:56.867779 14515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: No bootstrap required, opened a new log
Aug 11 07:05:56 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:56.876380 14515 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:05:56.876798 14515 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:56.876936 14515 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3087016853467c8c5655413c39aa70, State: Initialized, Role: FOLLOWER
I20260811 07:05:56.877693 14515 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:05:56.878024 14515 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:05:56.878214 14515 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:05:56.878412 14515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:56.879259 14519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:56.856355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32854 (local address 127.30.73.126:44257)
0811 07:05:56.857226 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:56.857238 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:56.857288 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:05:56.859123 (+ 1835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:56.859148 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:56.859512 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:56.859826 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:56.861942 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:56.863362 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:56.865313 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:56.866346 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:56.866504 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:56.871552 (+ 5048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:56.871562 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:56.871580 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:56.871621 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:56.874918 (+ 3297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:56.875666 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:56.875676 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:56.875689 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:56.875847 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:56.876252 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:56.876257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:56.876262 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:56.876866 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:56.877202 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:56.877641 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 07:05:56.878089 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":439,"threads_started":1}
I20260811 07:05:56.880929 14515 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:05:56.881439 14515 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3087016853467c8c5655413c39aa70; no voters:
I20260811 07:05:56.882221 14515 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:05:56.882344 14521 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:05:56.883068 14521 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 1 LEADER]: Becoming Leader. State: Replica: 1e3087016853467c8c5655413c39aa70, State: Running, Role: LEADER
I20260811 07:05:56.883635 14521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:05:56.884495 14515 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:05:56.886651 14522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e3087016853467c8c5655413c39aa70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } } }
I20260811 07:05:56.886757 14523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3087016853467c8c5655413c39aa70. Latest consensus state: current_term: 1 leader_uuid: "1e3087016853467c8c5655413c39aa70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } } }
I20260811 07:05:56.887096 14522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:56.887169 14523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: This master's current role is: LEADER
I20260811 07:05:56.890779 14526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:05:56.900188 14526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:05:56.909893 14526 catalog_manager.cc:1347] Generated new cluster ID: cbd2c24efced423fbf3a7488e5468a17
I20260811 07:05:56.910036 14526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:05:56.924904 14526 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:05:56.926331 14526 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:05:56.932412 14526 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Generated new TSK 0
I20260811 07:05:56.933549 14526 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:05:57.010564 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44257
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:05:57.364182 14544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:57.364521 14544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:57.364698 14544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:57.372501 14544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:57.372628 14544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:57.372805 14544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:05:57.386004 14544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:57.387424 14544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:57.388975 14544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:57.403813 14550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:57.403992 14549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:57.404052 14552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:57.404721 14544 server_base.cc:1034] running on GCE node
I20260811 07:05:57.405468 14544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:57.406579 14544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:57.407815 14544 hybrid_clock.cc:648] HybridClock initialized: now 1786431957407758 us; error 45 us; skew 500 ppm
I20260811 07:05:57.408231 14544 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:57 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431957, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:57.411703 14544 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:05:57.413213 14544 webserver.cc:460] Webserver started at http://127.30.73.65:35823/ using document root <none> and password file <none>
I20260811 07:05:57.413975 14544 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:57.414093 14544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:57.414366 14544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:05:57.417441 14544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "777bccc66b1eedca9d829dc689628fd8"
server_key_iv: "de8974a42c3093a621bcfe4bf5f26a92"
server_key_version: "encryptionkey@0"
I20260811 07:05:57.418398 14544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "777bccc66b1eedca9d829dc689628fd8"
server_key_iv: "de8974a42c3093a621bcfe4bf5f26a92"
server_key_version: "encryptionkey@0"
I20260811 07:05:57.424306 14544 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:05:57.428097 14560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:57.429551 14544 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:05:57.429692 14544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "777bccc66b1eedca9d829dc689628fd8"
server_key_iv: "de8974a42c3093a621bcfe4bf5f26a92"
server_key_version: "encryptionkey@0"
I20260811 07:05:57.429992 14544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:57.445425 14544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:57.450100 14544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:57.450436 14544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:57.451424 14544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:05:57.452759 14544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:05:57.452834 14544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:57.452920 14544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:05:57.452978 14544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:57.488669 14544 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:41081
I20260811 07:05:57.488713 14685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:41081 every 8 connection(s)
I20260811 07:05:57.490315 14544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:05:57.491639 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 14544
I20260811 07:05:57.491946 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:05:57.492831 31013 external_mini_cluster.cc:1428] Setting key 5d51e6ec4134c7e0b7a8b7eca348a5f2
Aug 11 07:05:57 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431957, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:57.516125 14689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:57.493683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:50655 (local address 127.30.73.126:44257)
0811 07:05:57.494329 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:57.494334 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:57.495606 (+ 1272us) server_negotiation.cc:407] Connection header received
0811 07:05:57.498509 (+ 2903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:57.498515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:57.498588 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:57.498701 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:57.500887 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:57.501623 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:57.504249 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:57.504632 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:57.504754 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:57.509312 (+ 4558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:57.509322 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:57.509330 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:57.509377 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:57.512375 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:57.513448 (+ 1073us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:57.513453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:57.513455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:57.513584 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:57.514138 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:57.514142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:57.514144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:57.514468 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:57.514588 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:57.515609 (+ 1021us) server_negotiation.cc:299] Negotiation successful
0811 07:05:57.515804 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":296,"threads_started":1}
I20260811 07:05:57.517850 14690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:57.494457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:50655)
0811 07:05:57.495411 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:57.495462 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:57.498177 (+ 2715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:57.498989 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:57.499005 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:57.499837 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:57.500671 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:57.500700 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:57.501849 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:57.501857 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:57.504079 (+ 2222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:57.504098 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:57.504898 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:57.504908 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:57.505237 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:57.506091 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:57.506127 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:57.509059 (+ 2932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:57.512562 (+ 3503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:57.512575 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:57.512597 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:57.513283 (+ 686us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:57.513704 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:57.513712 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:57.513718 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:57.514011 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:57.514608 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:57.514619 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:57.515125 (+ 506us) client_negotiation.cc:769] Sending connection context
0811 07:05:57.515459 (+ 334us) client_negotiation.cc:240] Negotiation successful
0811 07:05:57.516160 (+ 701us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":384,"threads_started":1}
I20260811 07:05:57.519997 14686 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44257
I20260811 07:05:57.520391 14686 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:57.521386 14686 heartbeater.cc:511] Master 127.30.73.126:44257 requested a full tablet report, sending...
I20260811 07:05:57.524122 14477 ts_manager.cc:194] Registered new tserver with Master: b11e65c0fa4f4e1ea36e2b5875e98a98 (127.30.73.65:41081)
I20260811 07:05:57.526461 14477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:50655
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:05:57.570675 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44257
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:05:57.918802 14693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:57.919083 14693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:57.919179 14693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:57.926626 14693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:57.926740 14693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:57.926852 14693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:05:57.937172 14693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:57.938548 14693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:57.939850 14693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:57.953384 14698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:57.953526 14699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:57.953558 14701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:57.954918 14693 server_base.cc:1034] running on GCE node
I20260811 07:05:57.955659 14693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:57.956684 14693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:57.957947 14693 hybrid_clock.cc:648] HybridClock initialized: now 1786431957957899 us; error 31 us; skew 500 ppm
I20260811 07:05:57.958316 14693 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:57 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431957, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:57.961609 14693 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:05:57.963140 14693 webserver.cc:460] Webserver started at http://127.30.73.66:37651/ using document root <none> and password file <none>
I20260811 07:05:57.963853 14693 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:57.964007 14693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:57.964330 14693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:05:57.967434 14693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "c6ffea592c8b4727a3153d7e816a9e0d"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "02f8bfe65ba8160cee1115d8c612b21d"
server_key_iv: "2f54b716ffe0241daecdb8709771ae9b"
server_key_version: "encryptionkey@0"
I20260811 07:05:57.968286 14693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "c6ffea592c8b4727a3153d7e816a9e0d"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "02f8bfe65ba8160cee1115d8c612b21d"
server_key_iv: "2f54b716ffe0241daecdb8709771ae9b"
server_key_version: "encryptionkey@0"
I20260811 07:05:57.973616 14693 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 07:05:57.977399 14709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:57.979142 14693 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:05:57.979382 14693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "c6ffea592c8b4727a3153d7e816a9e0d"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "02f8bfe65ba8160cee1115d8c612b21d"
server_key_iv: "2f54b716ffe0241daecdb8709771ae9b"
server_key_version: "encryptionkey@0"
I20260811 07:05:57.979614 14693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:58.003647 14693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:58.010135 14693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:58.010529 14693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:58.011970 14693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:05:58.014084 14693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:05:58.014192 14693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:58.014348 14693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:05:58.014416 14693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:58.052681 14693 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:42965
I20260811 07:05:58.052704 14830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:42965 every 8 connection(s)
I20260811 07:05:58.054109 14693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:05:58.064073 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 14693
I20260811 07:05:58.064288 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:05:58.064865 31013 external_mini_cluster.cc:1428] Setting key 28d295cc71823c26c43b3ff2ec389837
Aug 11 07:05:58 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431957, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:58.078917 14833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.056891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:37803 (local address 127.30.73.126:44257)
0811 07:05:58.057364 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:58.057369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:58.058402 (+ 1033us) server_negotiation.cc:407] Connection header received
0811 07:05:58.061215 (+ 2813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:58.061236 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:58.061353 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:58.061490 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:58.063706 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.064686 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.067258 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.067928 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.068077 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.071608 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:58.071617 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:58.071624 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:58.071671 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:58.075413 (+ 3742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:58.076193 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:58.076202 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:58.076208 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:58.076384 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:58.076815 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:58.076821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:58.076826 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:58.077245 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:58.077409 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:58.078259 (+ 850us) server_negotiation.cc:299] Negotiation successful
0811 07:05:58.078499 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":240,"threads_started":1}
I20260811 07:05:58.080322 14834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.057447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:37803)
0811 07:05:58.058234 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:58.058286 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:58.060826 (+ 2540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:58.061785 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:58.061798 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:58.062639 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:58.063488 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.063514 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.065396 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.065401 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.067061 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.067073 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.068149 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.068154 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.068356 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.069069 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:58.069096 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:58.071340 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:58.075577 (+ 4237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:58.075584 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:58.075599 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:58.076049 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:58.076495 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:58.076498 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:58.076501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:58.076685 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:58.077384 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:58.077390 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:58.077745 (+ 355us) client_negotiation.cc:769] Sending connection context
0811 07:05:58.078131 (+ 386us) client_negotiation.cc:240] Negotiation successful
0811 07:05:58.078693 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":341,"threads_started":1}
I20260811 07:05:58.082003 14831 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44257
I20260811 07:05:58.082351 14831 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:58.083300 14831 heartbeater.cc:511] Master 127.30.73.126:44257 requested a full tablet report, sending...
I20260811 07:05:58.085039 14477 ts_manager.cc:194] Registered new tserver with Master: c6ffea592c8b4727a3153d7e816a9e0d (127.30.73.66:42965)
I20260811 07:05:58.085974 14477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:37803
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:05:58.134073 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44257
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:05:58.487602 14838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:58.487872 14838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:58.488041 14838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:58.495811 14838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:58.495929 14838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:58.496135 14838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:05:58.506000 14838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:58.507297 14838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:58.508638 14838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:58.522341 14844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:58.522318 14845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:58.522830 14847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:58.523584 14838 server_base.cc:1034] running on GCE node
I20260811 07:05:58.524252 14838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:58.525287 14838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:58.526522 14838 hybrid_clock.cc:648] HybridClock initialized: now 1786431958526481 us; error 62 us; skew 500 ppm
I20260811 07:05:58.526876 14838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:58 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431958, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:58.529953 14686 heartbeater.cc:503] Master 127.30.73.126:44257 was elected leader, sending a full tablet report...
I20260811 07:05:58.530630 14838 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:05:58.532855 14838 webserver.cc:460] Webserver started at http://127.30.73.67:44459/ using document root <none> and password file <none>
I20260811 07:05:58.533564 14838 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:58.533674 14838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:05:58.534006 14838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:05:58.537020 14838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "8fc95ee35715434e948385fa9198d42e"
format_stamp: "Formatted at 2026-08-11 07:05:58 on dist-test-slave-69rg"
server_key: "4233a93f562925632899a53a8ed60b17"
server_key_iv: "5d0830d9a5e7af139731407b4d05a06b"
server_key_version: "encryptionkey@0"
I20260811 07:05:58.537793 14838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "8fc95ee35715434e948385fa9198d42e"
format_stamp: "Formatted at 2026-08-11 07:05:58 on dist-test-slave-69rg"
server_key: "4233a93f562925632899a53a8ed60b17"
server_key_iv: "5d0830d9a5e7af139731407b4d05a06b"
server_key_version: "encryptionkey@0"
I20260811 07:05:58.543192 14838 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260811 07:05:58.547497 14855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:58.549167 14838 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:05:58.549309 14838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "8fc95ee35715434e948385fa9198d42e"
format_stamp: "Formatted at 2026-08-11 07:05:58 on dist-test-slave-69rg"
server_key: "4233a93f562925632899a53a8ed60b17"
server_key_iv: "5d0830d9a5e7af139731407b4d05a06b"
server_key_version: "encryptionkey@0"
I20260811 07:05:58.549497 14838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:05:58.575659 14838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:05:58.580189 14838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:05:58.580449 14838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:05:58.581415 14838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:05:58.582849 14838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:05:58.582926 14838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:58.583106 14838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:05:58.583165 14838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:05:58.619405 14838 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:37611
I20260811 07:05:58.619443 14978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:37611 every 8 connection(s)
I20260811 07:05:58.620803 14838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:05:58.624256 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 14838
I20260811 07:05:58.624488 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:05:58.625054 31013 external_mini_cluster.cc:1428] Setting key 681983157c030f4902b38f10a4fc213d
Aug 11 07:05:58 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431958, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:05:58.642309 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.623521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:47841 (local address 127.30.73.126:44257)
0811 07:05:58.624110 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:58.624118 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:58.625113 (+ 995us) server_negotiation.cc:407] Connection header received
0811 07:05:58.627756 (+ 2643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:58.627762 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:58.627868 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:58.627994 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:58.629714 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.630596 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.632176 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.632581 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.632675 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.636328 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:58.636333 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:58.636337 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:58.636370 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:58.638994 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:58.639797 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:58.639801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:58.639803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:58.639979 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:58.640502 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:58.640509 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:58.640511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:58.640882 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:58.641073 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:58.641763 (+ 690us) server_negotiation.cc:299] Negotiation successful
0811 07:05:58.642004 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":285,"threads_started":1}
I20260811 07:05:58.643294 14983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.624060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:47841)
0811 07:05:58.624917 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:58.624973 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:58.627429 (+ 2456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:58.628214 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:58.628222 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:58.628965 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:05:58.629545 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.629562 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.630771 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.630775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.632035 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.632053 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.632792 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.632797 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.632989 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.633691 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:05:58.633717 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:05:58.636121 (+ 2404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:05:58.639138 (+ 3017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:58.639147 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:58.639163 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:58.639682 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:58.640111 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:05:58.640116 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:05:58.640120 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:05:58.640354 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:05:58.641040 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:05:58.641047 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:05:58.641423 (+ 376us) client_negotiation.cc:769] Sending connection context
0811 07:05:58.641668 (+ 245us) client_negotiation.cc:240] Negotiation successful
0811 07:05:58.642139 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":342,"threads_started":1}
I20260811 07:05:58.644791 14979 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44257
I20260811 07:05:58.645112 14979 heartbeater.cc:464] Registering TS with master...
I20260811 07:05:58.645956 14979 heartbeater.cc:511] Master 127.30.73.126:44257 requested a full tablet report, sending...
I20260811 07:05:58.647516 14477 ts_manager.cc:194] Registered new tserver with Master: 8fc95ee35715434e948385fa9198d42e (127.30.73.67:37611)
I20260811 07:05:58.648458 14477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:47841
I20260811 07:05:58.653759 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:05:58.673326 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.658493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32866 (local address 127.30.73.126:44257)
0811 07:05:58.658747 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:58.658757 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:58.659133 (+ 376us) server_negotiation.cc:407] Connection header received
0811 07:05:58.659343 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:58.659355 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:58.659420 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:58.659528 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:58.661143 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.661975 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.663373 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.663817 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.663963 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.666650 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:58.666656 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:58.666659 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:58.666693 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:58.670319 (+ 3626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:58.671079 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:58.671087 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:58.671092 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:58.671252 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:58.671692 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:58.671700 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:58.671705 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:58.672069 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:58.672349 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:58.672702 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 07:05:58.672965 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:05:58.678333 14477 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:05:58.686631 14477 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:05:58.710654 14993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.699535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:42965 (local address 127.0.0.1:53512)
0811 07:05:58.700314 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:58.700354 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:58.700538 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:58.702347 (+ 1809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:58.702355 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:58.702387 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:58.703102 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.703125 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.705330 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.705336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.707763 (+ 2427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.707780 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.709490 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.709496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.709694 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.709747 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 07:05:58.709912 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 07:05:58.710111 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"spinlock_wait_cycles":15744,"thread_start_us":817,"threads_started":1}
I20260811 07:05:58.711165 14994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.699673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:41081 (local address 127.0.0.1:51228)
0811 07:05:58.702294 (+ 2621us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:58.702313 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:58.702434 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:58.703467 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:58.703472 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:58.703498 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:58.703899 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.703909 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.705764 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.705771 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.708323 (+ 2552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.708340 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.710277 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.710284 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.710470 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.710501 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:05:58.710577 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 07:05:58.710736 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2470,"mutex_wait_us":2,"thread_start_us":2362,"threads_started":1}
I20260811 07:05:58.711673 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.699772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53512 (local address 127.30.73.66:42965)
0811 07:05:58.701680 (+ 1908us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:58.701686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:58.701709 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:05:58.701792 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:58.701797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:58.702102 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:58.702312 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:58.703361 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.705143 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.707930 (+ 2787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.709247 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.709395 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.709605 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:58.709965 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 07:05:58.710175 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1764,"thread_start_us":1675,"threads_started":1}
I20260811 07:05:58.712944 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.702385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:37611 (local address 127.0.0.1:34964)
0811 07:05:58.705043 (+ 2658us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:58.705069 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:58.705201 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:58.705932 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:58.705936 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:58.705973 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:58.706551 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.706581 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.708535 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.708546 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.710217 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.710233 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.712102 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.712110 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.712301 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.712332 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:05:58.712430 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 07:05:58.712589 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2526,"mutex_wait_us":2,"thread_start_us":2383,"threads_started":1}
I20260811 07:05:58.713012 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.703006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34964 (local address 127.30.73.67:37611)
0811 07:05:58.704589 (+ 1583us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:58.704598 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:58.705183 (+ 585us) server_negotiation.cc:407] Connection header received
0811 07:05:58.705335 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:58.705342 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:58.705578 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:58.705790 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:58.706806 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.708389 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.710426 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.711886 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.712009 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.712208 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:58.712505 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 07:05:58.712651 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1412,"thread_start_us":1230,"threads_started":1}
I20260811 07:05:58.713513 14996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.700316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51228 (local address 127.30.73.65:41081)
0811 07:05:58.702172 (+ 1856us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:58.702181 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:58.702576 (+ 395us) server_negotiation.cc:407] Connection header received
0811 07:05:58.702699 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:58.702721 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:58.702935 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:58.703174 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:58.704088 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.705626 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.708522 (+ 2896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.709993 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.711496 (+ 1503us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.711752 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:58.712852 (+ 1100us) server_negotiation.cc:299] Negotiation successful
0811 07:05:58.713192 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1704,"thread_start_us":1542,"threads_started":1}
I20260811 07:05:58.716085 14759 tablet_service.cc:1467] Processing CreateTablet for tablet cbca895b20424dccad32a73859d23559 (DEFAULT_TABLE table=test-table [id=e9e51189e19a41118cba7d2b837183a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:05:58.716518 14907 tablet_service.cc:1467] Processing CreateTablet for tablet cbca895b20424dccad32a73859d23559 (DEFAULT_TABLE table=test-table [id=e9e51189e19a41118cba7d2b837183a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:05:58.716696 14610 tablet_service.cc:1467] Processing CreateTablet for tablet cbca895b20424dccad32a73859d23559 (DEFAULT_TABLE table=test-table [id=e9e51189e19a41118cba7d2b837183a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:05:58.717716 14759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbca895b20424dccad32a73859d23559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:58.717902 14907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbca895b20424dccad32a73859d23559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:58.718101 14610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbca895b20424dccad32a73859d23559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:05:58.730978 15000 tablet_bootstrap.cc:492] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: Bootstrap starting.
I20260811 07:05:58.734748 15000 tablet_bootstrap.cc:654] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:58.735926 15003 tablet_bootstrap.cc:492] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: Bootstrap starting.
I20260811 07:05:58.736220 15000 log.cc:824] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:58.737028 15001 tablet_bootstrap.cc:492] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: Bootstrap starting.
I20260811 07:05:58.739434 15000 tablet_bootstrap.cc:492] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: No bootstrap required, opened a new log
I20260811 07:05:58.739677 15003 tablet_bootstrap.cc:654] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:58.739732 15000 ts_tablet_manager.cc:1397] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 07:05:58.740665 15001 tablet_bootstrap.cc:654] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: Neither blocks nor log segments found. Creating new log.
I20260811 07:05:58.740960 15003 log.cc:824] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:58.741981 15001 log.cc:824] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:05:58.744163 15003 tablet_bootstrap.cc:492] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: No bootstrap required, opened a new log
I20260811 07:05:58.744460 15003 ts_tablet_manager.cc:1397] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260811 07:05:58.745034 15001 tablet_bootstrap.cc:492] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: No bootstrap required, opened a new log
I20260811 07:05:58.745306 15001 ts_tablet_manager.cc:1397] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260811 07:05:58.748005 15000 raft_consensus.cc:348] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } }
I20260811 07:05:58.748459 15000 raft_consensus.cc:374] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:58.748574 15000 raft_consensus.cc:729] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b11e65c0fa4f4e1ea36e2b5875e98a98, State: Initialized, Role: FOLLOWER
I20260811 07:05:58.749336 15000 consensus_queue.cc:260] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } }
I20260811 07:05:58.751848 15000 ts_tablet_manager.cc:1428] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260811 07:05:58.755623 15003 raft_consensus.cc:348] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } }
I20260811 07:05:58.756145 15003 raft_consensus.cc:374] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:58.756268 15003 raft_consensus.cc:729] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc95ee35715434e948385fa9198d42e, State: Initialized, Role: FOLLOWER
I20260811 07:05:58.756208 15001 raft_consensus.cc:348] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } }
I20260811 07:05:58.756642 15001 raft_consensus.cc:374] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:05:58.756778 15001 raft_consensus.cc:729] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ffea592c8b4727a3153d7e816a9e0d, State: Initialized, Role: FOLLOWER
I20260811 07:05:58.756973 15003 consensus_queue.cc:260] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } }
I20260811 07:05:58.757380 15001 consensus_queue.cc:260] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } }
I20260811 07:05:58.758292 14979 heartbeater.cc:503] Master 127.30.73.126:44257 was elected leader, sending a full tablet report...
I20260811 07:05:58.759001 15003 ts_tablet_manager.cc:1428] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260811 07:05:58.759830 14831 heartbeater.cc:503] Master 127.30.73.126:44257 was elected leader, sending a full tablet report...
I20260811 07:05:58.760174 15001 ts_tablet_manager.cc:1428] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
W20260811 07:05:58.806209 14832 tablet.cc:2369] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:05:58.872716 14981 tablet.cc:2369] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:05:58.894353 15010 raft_consensus.cc:482] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:05:58.894767 15010 raft_consensus.cc:504] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } }
I20260811 07:05:58.896585 15010 leader_election.cc:288] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ffea592c8b4727a3153d7e816a9e0d (127.30.73.66:42965), 8fc95ee35715434e948385fa9198d42e (127.30.73.67:37611)
I20260811 07:05:58.904090 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.897046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:33409 (local address 127.30.73.67:37611)
0811 07:05:58.897296 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:58.897303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:58.898230 (+ 927us) server_negotiation.cc:407] Connection header received
0811 07:05:58.898464 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:58.898469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:58.898541 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:58.898642 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:58.899247 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.900009 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.902257 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.903046 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.903242 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.903331 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:58.903690 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 07:05:58.903821 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:05:58.904120 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.897392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:41721 (local address 127.30.73.66:42965)
0811 07:05:58.897625 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:58.897632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:58.898327 (+ 695us) server_negotiation.cc:407] Connection header received
0811 07:05:58.898534 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:58.898538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:58.898599 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:58.898707 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:05:58.899369 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.900067 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.902244 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.903058 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.903278 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.903363 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:58.903715 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 07:05:58.903850 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:05:58.904404 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.896901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:37611 (local address 127.30.73.65:33409)
0811 07:05:58.898104 (+ 1203us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:58.898124 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:58.898315 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:58.898666 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:58.898670 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:58.898695 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:58.899099 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.899109 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.900151 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.900157 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.902092 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.902105 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.903307 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.903314 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.903501 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.903540 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 07:05:58.903655 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:05:58.903790 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1074,"mutex_wait_us":123,"thread_start_us":884,"threads_started":1}
I20260811 07:05:58.904485 15014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.896974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:42965 (local address 127.30.73.65:41721)
0811 07:05:58.898207 (+ 1233us) negotiation.cc:107] Waiting for socket to connect
0811 07:05:58.898222 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:05:58.898385 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:05:58.898721 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:05:58.898725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:05:58.898754 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:05:58.899204 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.899214 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.900231 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.900235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.902079 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:05:58.902092 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.903347 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.903353 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:05:58.903514 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.903571 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 07:05:58.903681 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 07:05:58.903813 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1103,"mutex_wait_us":122,"thread_start_us":496,"threads_started":1}
I20260811 07:05:58.905568 14931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbca895b20424dccad32a73859d23559" candidate_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc95ee35715434e948385fa9198d42e" is_pre_election: true
I20260811 07:05:58.905568 14779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbca895b20424dccad32a73859d23559" candidate_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" is_pre_election: true
I20260811 07:05:58.906101 14779 raft_consensus.cc:2454] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b11e65c0fa4f4e1ea36e2b5875e98a98 in term 0.
I20260811 07:05:58.906101 14931 raft_consensus.cc:2454] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b11e65c0fa4f4e1ea36e2b5875e98a98 in term 0.
I20260811 07:05:58.906844 14564 leader_election.cc:302] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc95ee35715434e948385fa9198d42e, b11e65c0fa4f4e1ea36e2b5875e98a98; no voters:
I20260811 07:05:58.907325 15010 raft_consensus.cc:2781] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:05:58.907513 15010 raft_consensus.cc:482] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:05:58.907634 15010 raft_consensus.cc:3037] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:58.909972 15010 raft_consensus.cc:504] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } }
I20260811 07:05:58.910629 15010 leader_election.cc:288] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [CANDIDATE]: Term 1 election: Requested vote from peers c6ffea592c8b4727a3153d7e816a9e0d (127.30.73.66:42965), 8fc95ee35715434e948385fa9198d42e (127.30.73.67:37611)
I20260811 07:05:58.911276 14931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbca895b20424dccad32a73859d23559" candidate_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc95ee35715434e948385fa9198d42e"
I20260811 07:05:58.911300 14779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbca895b20424dccad32a73859d23559" candidate_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ffea592c8b4727a3153d7e816a9e0d"
I20260811 07:05:58.911660 14779 raft_consensus.cc:3037] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:58.911674 14931 raft_consensus.cc:3037] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:05:58.915292 14931 raft_consensus.cc:2454] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b11e65c0fa4f4e1ea36e2b5875e98a98 in term 1.
I20260811 07:05:58.915292 14779 raft_consensus.cc:2454] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b11e65c0fa4f4e1ea36e2b5875e98a98 in term 1.
I20260811 07:05:58.915807 14563 leader_election.cc:302] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b11e65c0fa4f4e1ea36e2b5875e98a98, c6ffea592c8b4727a3153d7e816a9e0d; no voters:
I20260811 07:05:58.916129 15010 raft_consensus.cc:2781] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:05:58.916641 15010 raft_consensus.cc:686] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 1 LEADER]: Becoming Leader. State: Replica: b11e65c0fa4f4e1ea36e2b5875e98a98, State: Running, Role: LEADER
I20260811 07:05:58.917160 15010 consensus_queue.cc:237] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } }
I20260811 07:05:58.922499 14477 catalog_manager.cc:5495] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 reported cstate change: term changed from 0 to 1, leader changed from <none> to b11e65c0fa4f4e1ea36e2b5875e98a98 (127.30.73.65). New cstate: current_term: 1 leader_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } health_report { overall_health: UNKNOWN } } }
I20260811 07:05:58.951455 14996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:58.945759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51230 (local address 127.30.73.65:41081)
0811 07:05:58.945997 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:58.946003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:58.946021 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:05:58.946149 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:58.946153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:58.946240 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:58.946386 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:05:58.946765 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.947606 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.949140 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:58.949615 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:58.949726 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:58.950308 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:05:58.950862 (+ 554us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:05:58.950992 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:58.951146 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 07:05:58.951223 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 07:05:58.960464 14931 raft_consensus.cc:1261] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [term 1 FOLLOWER]: Refusing update from remote peer b11e65c0fa4f4e1ea36e2b5875e98a98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:05:58.960462 14779 raft_consensus.cc:1261] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [term 1 FOLLOWER]: Refusing update from remote peer b11e65c0fa4f4e1ea36e2b5875e98a98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:05:58.961480 15016 consensus_queue.cc:1035] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:05:58.962101 15010 consensus_queue.cc:1035] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:05:58.975585 15019 mvcc.cc:205] Tried to move back new op lower bound from 7317225303891038208 to 7317225303728730112. Current Snapshot: MvccSnapshot[applied={T|T < 7317225303891038208}]
I20260811 07:05:58.977476 15020 mvcc.cc:205] Tried to move back new op lower bound from 7317225303891038208 to 7317225303728730112. Current Snapshot: MvccSnapshot[applied={T|T < 7317225303891038208}]
I20260811 07:05:58.990654 14477 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:05:58.990931 14477 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:05:58.996740 14477 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Sending DeleteTablet for 3 replicas of tablet cbca895b20424dccad32a73859d23559
I20260811 07:05:58.998685 14907 tablet_service.cc:1514] Processing DeleteTablet for tablet cbca895b20424dccad32a73859d23559 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:05:58 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:34964
I20260811 07:05:58.998687 14759 tablet_service.cc:1514] Processing DeleteTablet for tablet cbca895b20424dccad32a73859d23559 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:05:58 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:53512
I20260811 07:05:58.999727 15031 tablet_replica.cc:330] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: stopping tablet replica
I20260811 07:05:58.999897 14610 tablet_service.cc:1514] Processing DeleteTablet for tablet cbca895b20424dccad32a73859d23559 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:05:58 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:51228
I20260811 07:05:59.000362 15031 raft_consensus.cc:2229] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:05:59.000994 15031 raft_consensus.cc:2258] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:05:59.001300 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 14544
I20260811 07:05:59.001930 15032 tablet_replica.cc:330] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: stopping tablet replica
I20260811 07:05:59.002353 15032 raft_consensus.cc:2229] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:05:59.002840 15032 raft_consensus.cc:2258] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:05:59.004738 15031 ts_tablet_manager.cc:1905] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:05:59.004884 15032 ts_tablet_manager.cc:1905] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:05:59.012202 15032 ts_tablet_manager.cc:1918] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:05:59.012400 15032 log.cc:1196] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/cbca895b20424dccad32a73859d23559
I20260811 07:05:59.012975 15032 ts_tablet_manager.cc:1939] T cbca895b20424dccad32a73859d23559 P c6ffea592c8b4727a3153d7e816a9e0d: Deleting consensus metadata
I20260811 07:05:59.013612 15031 ts_tablet_manager.cc:1918] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:05:59.013810 15031 log.cc:1196] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/cbca895b20424dccad32a73859d23559
I20260811 07:05:59.014501 15031 ts_tablet_manager.cc:1939] T cbca895b20424dccad32a73859d23559 P 8fc95ee35715434e948385fa9198d42e: Deleting consensus metadata
I20260811 07:05:59.015177 14459 catalog_manager.cc:4841] TS c6ffea592c8b4727a3153d7e816a9e0d (127.30.73.66:42965): tablet cbca895b20424dccad32a73859d23559 (table test-table [id=e9e51189e19a41118cba7d2b837183a8]) successfully deleted
I20260811 07:05:59.016595 14460 catalog_manager.cc:4841] TS 8fc95ee35715434e948385fa9198d42e (127.30.73.67:37611): tablet cbca895b20424dccad32a73859d23559 (table test-table [id=e9e51189e19a41118cba7d2b837183a8]) successfully deleted
I20260811 07:05:59.017866 15033 tablet_replica.cc:330] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: stopping tablet replica
I20260811 07:05:59.018436 15033 raft_consensus.cc:2229] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:05:59.019199 15033 raft_consensus.cc:2258] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:05:59.021306 15033 ts_tablet_manager.cc:1905] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 07:05:59 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:05:59.028590 15033 ts_tablet_manager.cc:1918] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:05:59.028784 15033 log.cc:1196] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/cbca895b20424dccad32a73859d23559
I20260811 07:05:59.029295 15033 ts_tablet_manager.cc:1939] T cbca895b20424dccad32a73859d23559 P b11e65c0fa4f4e1ea36e2b5875e98a98: Deleting consensus metadata
I20260811 07:05:59.031406 14460 catalog_manager.cc:4841] TS b11e65c0fa4f4e1ea36e2b5875e98a98 (127.30.73.65:41081): tablet cbca895b20424dccad32a73859d23559 (table test-table [id=e9e51189e19a41118cba7d2b837183a8]) successfully deleted
I20260811 07:05:59.036636 14996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:59.002899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51232 (local address 127.30.73.65:41081)
0811 07:05:59.003100 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:59.003109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:59.016994 (+ 13885us) server_negotiation.cc:407] Connection header received
0811 07:05:59.017236 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:59.017243 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:59.017422 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:59.017540 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:59.019690 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:59.020853 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:59.022929 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:59.023720 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:59.023864 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:59.029621 (+ 5757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:59.029636 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:59.029656 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:59.029704 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:59.033408 (+ 3704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:59.034401 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:59.034410 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:59.034412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:59.034567 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:59.035013 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:59.035016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:59.035018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:59.035408 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:59.035645 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:59.036092 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 07:05:59.036303 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:05:59.037487 14681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:59.141464 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 14544
I20260811 07:05:59.164788 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 14693
Aug 11 07:05:59 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:05:59.185045 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:59.165687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.30.73.66:42965)
0811 07:05:59.165925 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:59.165931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:59.165974 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:05:59.166050 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:59.166057 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:59.166139 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:59.166256 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:59.167865 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:59.169162 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:59.171368 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:59.172113 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:59.172280 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:59.178912 (+ 6632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:59.178930 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:59.178948 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:59.178996 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:59.182024 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:59.182752 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:59.182760 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:59.182762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:59.182935 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:59.183317 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:59.183321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:59.183323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:59.183785 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:59.184006 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:59.184461 (+ 455us) server_negotiation.cc:299] Negotiation successful
0811 07:05:59.184670 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:05:59.185900 14826 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:59.279017 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 14693
I20260811 07:05:59.300864 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 14838
Aug 11 07:05:59 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:05:59.318372 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:05:59.301788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53350 (local address 127.30.73.67:37611)
0811 07:05:59.301988 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:05:59.301993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:05:59.302012 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:05:59.302172 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:05:59.302176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:05:59.302279 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:05:59.302377 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:05:59.303768 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:59.304516 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:59.306231 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:05:59.306641 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:05:59.306745 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:05:59.311613 (+ 4868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:05:59.311633 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:05:59.311675 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:05:59.311717 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:05:59.314830 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:59.315823 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:59.315833 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:59.315835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:59.316020 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:05:59.316583 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:05:59.316588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:05:59.316590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:05:59.317002 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:05:59.317292 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 07:05:59.317659 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 07:05:59.317929 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:05:59.319203 14974 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:59.411324 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 14838
I20260811 07:05:59.433941 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 14441
I20260811 07:05:59.435181 14510 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:05:59.549878 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 14441
I20260811 07:05:59.577528 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44257
--webserver_interface=127.30.73.126
--webserver_port=36755
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:05:59.927414 15039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:05:59.927718 15039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:05:59.927811 15039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:05:59.935065 15039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:05:59.935192 15039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:05:59.935241 15039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:05:59.935293 15039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:05:59.935340 15039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:05:59.946226 15039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=36755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:05:59.947499 15039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:05:59.948777 15039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:05:59.975864 15048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:59.975934 15046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:05:59.975885 15045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:05:59.979354 15039 server_base.cc:1034] running on GCE node
I20260811 07:05:59.980320 15039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:05:59.982084 15039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:05:59.983340 15039 hybrid_clock.cc:648] HybridClock initialized: now 1786431959983290 us; error 58 us; skew 500 ppm
I20260811 07:05:59.983777 15039 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:05:59 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431959, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:05:59.994148 15039 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:05:59.996131 15039 webserver.cc:460] Webserver started at http://127.30.73.126:36755/ using document root <none> and password file <none>
I20260811 07:05:59.997041 15039 fs_manager.cc:359] Metadata directory not provided
I20260811 07:05:59.997170 15039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:00.003364 15039 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260811 07:06:00.006598 15055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:00.008190 15039 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:06:00.008419 15039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "1e3087016853467c8c5655413c39aa70"
format_stamp: "Formatted at 2026-08-11 07:05:56 on dist-test-slave-69rg"
server_key: "149d45b41861ac383d6063cd0ec2a8ff"
server_key_iv: "8977dc852f990519521b418bb03a59b7"
server_key_version: "encryptionkey@0"
I20260811 07:06:00.009549 15039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:00.029469 15039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:00.034687 15039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:00.035050 15039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:00.056418 15039 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:44257
I20260811 07:06:00.056500 15111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:44257 every 8 connection(s)
I20260811 07:06:00.058234 15039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:06:00.066268 15112 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:06:00.068871 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 15039
I20260811 07:06:00.070086 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:41081
--local_ip_for_outbound_sockets=127.30.73.65
--tserver_master_addrs=127.30.73.126:44257
--webserver_port=35823
--webserver_interface=127.30.73.65
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:06:00.070842 15112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Bootstrap starting.
I20260811 07:06:00.091809 15112 log.cc:824] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:00.104489 15112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:06:00.105062 15112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Bootstrap complete.
I20260811 07:06:00.114782 15112 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:06:00.115648 15112 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3087016853467c8c5655413c39aa70, State: Initialized, Role: FOLLOWER
I20260811 07:06:00.116303 15112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:06:00.116550 15112 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:06:00.116711 15112 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:06:00.116909 15112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:06:00.120968 15112 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:06:00.121517 15112 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3087016853467c8c5655413c39aa70; no voters:
I20260811 07:06:00.122254 15112 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:06:00.122387 15116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:06:00.123621 15116 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 2 LEADER]: Becoming Leader. State: Replica: 1e3087016853467c8c5655413c39aa70, State: Running, Role: LEADER
I20260811 07:06:00.124209 15116 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:06:00.124675 15112 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:06:00.127147 15117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1e3087016853467c8c5655413c39aa70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } } }
I20260811 07:06:00.127274 15118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3087016853467c8c5655413c39aa70. Latest consensus state: current_term: 2 leader_uuid: "1e3087016853467c8c5655413c39aa70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } } }
I20260811 07:06:00.127589 15118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: This master's current role is: LEADER
I20260811 07:06:00.127593 15117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: This master's current role is: LEADER
I20260811 07:06:00.138697 15124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:06:00.148972 15124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:06:00.150491 15124 catalog_manager.cc:1259] Loaded cluster ID: cbd2c24efced423fbf3a7488e5468a17
I20260811 07:06:00.150612 15124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:06:00.154598 15124 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 07:06:00.172926 15124 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 07:06:00.200225 15124 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:06:00.202144 15124 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Loaded TSK: 0
I20260811 07:06:00.203675 15124 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:06:00.450986 15114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:00.451355 15114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:00.451547 15114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:00.459373 15114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:00.459537 15114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:00.459728 15114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:06:00.469784 15114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:41081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=35823
--tserver_master_addrs=127.30.73.126:44257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:00.471268 15114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:00.472646 15114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:00.486552 15141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:00.486743 15140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:00.487370 15143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:00.488718 15114 server_base.cc:1034] running on GCE node
I20260811 07:06:00.489542 15114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:00.490887 15114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:00.492159 15114 hybrid_clock.cc:648] HybridClock initialized: now 1786431960492095 us; error 43 us; skew 500 ppm
I20260811 07:06:00.492558 15114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:00 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431960, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:00.496969 15114 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:06:00.498878 15114 webserver.cc:460] Webserver started at http://127.30.73.65:35823/ using document root <none> and password file <none>
I20260811 07:06:00.499756 15114 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:00.499922 15114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:00.506136 15114 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:06:00.509178 15153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:00.510653 15114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:06:00.510871 15114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "777bccc66b1eedca9d829dc689628fd8"
server_key_iv: "de8974a42c3093a621bcfe4bf5f26a92"
server_key_version: "encryptionkey@0"
I20260811 07:06:00.511899 15114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:00.524224 15114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:00.528817 15114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:00.529109 15114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:00.530160 15114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:00.531654 15114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:00.531791 15114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:00.531917 15114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:00.532006 15114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:00.569416 15114 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:41081
I20260811 07:06:00.569510 15282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:41081 every 8 connection(s)
I20260811 07:06:00.571177 15114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:06:00.581358 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 15114
I20260811 07:06:00.582235 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:42965
--local_ip_for_outbound_sockets=127.30.73.66
--tserver_master_addrs=127.30.73.126:44257
--webserver_port=37651
--webserver_interface=127.30.73.66
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:06:00 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431960, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:00.597270 15287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:00.574387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:55873)
0811 07:06:00.575231 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:00.575277 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:00.577029 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:00.578499 (+ 1470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:00.578507 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:00.579029 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:06:00.579578 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:00.579596 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:00.581409 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:00.581416 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:00.583643 (+ 2227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:00.583664 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:00.584799 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:00.584810 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:00.585109 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:00.585943 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:06:00.585979 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:06:00.588863 (+ 2884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:06:00.592641 (+ 3778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:00.592652 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:00.592668 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:00.593144 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:00.593753 (+ 609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:00.593762 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:00.593766 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:00.594066 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:00.595124 (+ 1058us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:06:00.595131 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:06:00.595455 (+ 324us) client_negotiation.cc:769] Sending connection context
0811 07:06:00.595694 (+ 239us) client_negotiation.cc:240] Negotiation successful
0811 07:06:00.596184 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":372,"threads_started":1}
I20260811 07:06:00.597754 15285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:00.574240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:55873 (local address 127.30.73.126:44257)
0811 07:06:00.574888 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:00.574900 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:00.575433 (+ 533us) server_negotiation.cc:407] Connection header received
0811 07:06:00.577590 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:00.577604 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:00.578026 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:00.578373 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:00.579834 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:00.581207 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:00.583822 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:00.584530 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:00.584683 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:00.589193 (+ 4510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:00.589201 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:00.589217 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:00.589262 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:00.592452 (+ 3190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:00.593322 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:00.593329 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:00.593334 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:00.593576 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:00.594242 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:00.594246 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:00.594248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:00.594941 (+ 693us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:00.595161 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:00.595997 (+ 836us) server_negotiation.cc:299] Negotiation successful
0811 07:06:00.596462 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":294,"threads_started":1}
I20260811 07:06:00.600620 15283 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44257
I20260811 07:06:00.600970 15283 heartbeater.cc:464] Registering TS with master...
I20260811 07:06:00.601975 15283 heartbeater.cc:511] Master 127.30.73.126:44257 requested a full tablet report, sending...
I20260811 07:06:00.604487 15074 ts_manager.cc:194] Registered new tserver with Master: b11e65c0fa4f4e1ea36e2b5875e98a98 (127.30.73.65:41081)
I20260811 07:06:00.606153 15074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:55873
W20260811 07:06:00.966121 15289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:00.966450 15289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:00.966555 15289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:00.978981 15289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:00.979137 15289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:00.979357 15289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:06:00.990844 15289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:42965
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=37651
--tserver_master_addrs=127.30.73.126:44257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:00.993220 15289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:00.994825 15289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:01.014899 15295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:01.014828 15294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:01.015049 15289 server_base.cc:1034] running on GCE node
W20260811 07:06:01.017196 15297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:01.019083 15289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:01.021322 15289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:01.025776 15289 hybrid_clock.cc:648] HybridClock initialized: now 1786431961025386 us; error 378 us; skew 500 ppm
I20260811 07:06:01.026405 15289 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:01 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431961, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:01.034583 15289 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:06:01.037678 15289 webserver.cc:460] Webserver started at http://127.30.73.66:37651/ using document root <none> and password file <none>
I20260811 07:06:01.038772 15289 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:01.038933 15289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:01.046340 15289 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:06:01.051205 15306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:01.054857 15289 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260811 07:06:01.056933 15289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "c6ffea592c8b4727a3153d7e816a9e0d"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "02f8bfe65ba8160cee1115d8c612b21d"
server_key_iv: "2f54b716ffe0241daecdb8709771ae9b"
server_key_version: "encryptionkey@0"
I20260811 07:06:01.059072 15289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:01.102689 15289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:01.112498 15289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:01.113116 15289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:01.115468 15289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:01.118203 15289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:01.118366 15289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:01.118706 15289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:01.119172 15289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:01.170073 15289 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:42965
I20260811 07:06:01.170128 15434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:42965 every 8 connection(s)
I20260811 07:06:01.172199 15289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:06:01.181761 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 15289
I20260811 07:06:01.182485 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:37611
--local_ip_for_outbound_sockets=127.30.73.67
--tserver_master_addrs=127.30.73.126:44257
--webserver_port=44459
--webserver_interface=127.30.73.67
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:06:01 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431961, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:01.198084 15437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.175364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:56541 (local address 127.30.73.126:44257)
0811 07:06:01.175990 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.175995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.176826 (+ 831us) server_negotiation.cc:407] Connection header received
0811 07:06:01.178849 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.178855 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.178945 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.179071 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:01.181369 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.182368 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.185366 (+ 2998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.185930 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.187048 (+ 1118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.190985 (+ 3937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:01.190992 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:01.190995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:01.191032 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:01.194299 (+ 3267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:01.195220 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:01.195224 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:01.195226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:01.195358 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:01.195834 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:01.195840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:01.195843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:01.196148 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:01.196318 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.197374 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.197652 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":393,"threads_started":1}
I20260811 07:06:01.199126 15438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.175801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:56541)
0811 07:06:01.176608 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:01.176650 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:01.178534 (+ 1884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:01.179335 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:01.179343 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:01.179885 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:06:01.180964 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.181002 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.182861 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.182868 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.185055 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.185090 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.187188 (+ 2098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.187199 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.187486 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.188282 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:06:01.188307 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:06:01.190700 (+ 2393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:06:01.194489 (+ 3789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:01.194499 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:01.194521 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:01.195053 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:01.195490 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:01.195495 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:01.195498 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:01.195709 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:01.196305 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:06:01.196313 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:06:01.196928 (+ 615us) client_negotiation.cc:769] Sending connection context
0811 07:06:01.197268 (+ 340us) client_negotiation.cc:240] Negotiation successful
0811 07:06:01.197884 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":318,"threads_started":1}
I20260811 07:06:01.200851 15435 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44257
I20260811 07:06:01.201249 15435 heartbeater.cc:464] Registering TS with master...
I20260811 07:06:01.202246 15435 heartbeater.cc:511] Master 127.30.73.126:44257 requested a full tablet report, sending...
I20260811 07:06:01.204207 15074 ts_manager.cc:194] Registered new tserver with Master: c6ffea592c8b4727a3153d7e816a9e0d (127.30.73.66:42965)
I20260811 07:06:01.205610 15074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:56541
W20260811 07:06:01.551163 15439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:01.551474 15439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:01.551579 15439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:01.560518 15439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:01.560642 15439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:01.560760 15439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:06:01.571036 15439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:37611
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=44459
--tserver_master_addrs=127.30.73.126:44257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:01.572373 15439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:01.573681 15439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:01.588253 15445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:01.588403 15444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:01.588377 15448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:01.589300 15439 server_base.cc:1034] running on GCE node
I20260811 07:06:01.590080 15439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:01.591176 15439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:01.592454 15439 hybrid_clock.cc:648] HybridClock initialized: now 1786431961592411 us; error 36 us; skew 500 ppm
I20260811 07:06:01.592834 15439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:01 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431961, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:01.596604 15439 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:06:01.598340 15439 webserver.cc:460] Webserver started at http://127.30.73.67:44459/ using document root <none> and password file <none>
I20260811 07:06:01.599040 15439 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:01.599169 15439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:01.605043 15439 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:06:01.608170 15456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:01.609668 15439 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:06:01.610339 15283 heartbeater.cc:503] Master 127.30.73.126:44257 was elected leader, sending a full tablet report...
I20260811 07:06:01.609915 15439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "8fc95ee35715434e948385fa9198d42e"
format_stamp: "Formatted at 2026-08-11 07:05:58 on dist-test-slave-69rg"
server_key: "4233a93f562925632899a53a8ed60b17"
server_key_iv: "5d0830d9a5e7af139731407b4d05a06b"
server_key_version: "encryptionkey@0"
I20260811 07:06:01.611181 15439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:01.635182 15439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:01.640727 15439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:01.641062 15439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:01.642305 15439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:01.643778 15439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:01.643925 15439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:01.644070 15439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:01.644162 15439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:01.683022 15439 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:37611
I20260811 07:06:01.683143 15580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:37611 every 8 connection(s)
I20260811 07:06:01.684638 15439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:06:01.688400 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 15439
Aug 11 07:06:01 dist-test-slave-69rg krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431961, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:01.711400 15585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.689644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42254 (local address 127.30.73.126:44257)
0811 07:06:01.692869 (+ 3225us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.692873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.692890 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:06:01.692933 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.692936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.692992 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.693080 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:01.695186 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.696741 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.699151 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.699944 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.700065 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.704327 (+ 4262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:01.704333 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:01.704336 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:01.704374 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:01.708325 (+ 3951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:01.709304 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:01.709308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:01.709311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:01.709435 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:01.709913 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:01.709918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:01.709921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:01.710246 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:01.710530 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.710833 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.711023 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":3125,"thread_start_us":2979,"threads_started":1}
I20260811 07:06:01.712390 15437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.688233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:55953 (local address 127.30.73.126:44257)
0811 07:06:01.688468 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.688476 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.689964 (+ 1488us) server_negotiation.cc:407] Connection header received
0811 07:06:01.691999 (+ 2035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.692004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.692150 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.692265 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:01.694755 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.695992 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.698937 (+ 2945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.699721 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.699873 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.704983 (+ 5110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:01.704991 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:01.705001 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:01.705047 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:01.708699 (+ 3652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:01.709647 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:01.709651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:01.709653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:01.709791 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:01.710335 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:01.710343 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:01.710348 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:01.710690 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:01.710825 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.711810 (+ 985us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.712025 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":85}
I20260811 07:06:01.713703 15583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.688741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:55953)
0811 07:06:01.689774 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:01.689848 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:01.691699 (+ 1851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:01.692751 (+ 1052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:01.692767 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:01.693564 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:06:01.694522 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.694550 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.696370 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.696375 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.698596 (+ 2221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.698756 (+ 160us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.700033 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.700042 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.700425 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.701384 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:06:01.701427 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:06:01.704689 (+ 3262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:06:01.708859 (+ 4170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:01.708868 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:01.708887 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:01.709520 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:01.709954 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:01.709957 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:01.709960 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:01.710207 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:01.710838 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:06:01.710846 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:06:01.711379 (+ 533us) client_negotiation.cc:769] Sending connection context
0811 07:06:01.711698 (+ 319us) client_negotiation.cc:240] Negotiation successful
0811 07:06:01.712330 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":518,"threads_started":1}
I20260811 07:06:01.715216 15581 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44257
I20260811 07:06:01.715550 15581 heartbeater.cc:464] Registering TS with master...
I20260811 07:06:01.716468 15581 heartbeater.cc:511] Master 127.30.73.126:44257 requested a full tablet report, sending...
I20260811 07:06:01.718429 15074 ts_manager.cc:194] Registered new tserver with Master: 8fc95ee35715434e948385fa9198d42e (127.30.73.67:37611)
I20260811 07:06:01.719280 15074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:55953
I20260811 07:06:01.727140 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:06:01.735476 15437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.728171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42262 (local address 127.30.73.126:44257)
0811 07:06:01.728415 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.728425 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.728830 (+ 405us) server_negotiation.cc:407] Connection header received
0811 07:06:01.728993 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.728997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.729184 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.729329 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:06:01.729763 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.730700 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.732420 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.732953 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.733074 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.733713 (+ 639us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:06:01.734389 (+ 676us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:06:01.734520 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.735072 (+ 552us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.735181 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:06:01.736994 15074 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:42262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:06:01.747689 15074 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:06:01.776469 15591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.762117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:41081 (local address 127.0.0.1:44074)
0811 07:06:01.763310 (+ 1193us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:01.763367 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:01.763556 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:01.764653 (+ 1097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:01.764661 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:01.764709 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:01.765271 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.765289 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.768424 (+ 3135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.768434 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.771800 (+ 3366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.771826 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.774962 (+ 3136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.774971 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.775306 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.775382 (+ 76us) client_negotiation.cc:769] Sending connection context
0811 07:06:01.775564 (+ 182us) client_negotiation.cc:240] Negotiation successful
0811 07:06:01.775840 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":837,"thread_start_us":658,"threads_started":1}
I20260811 07:06:01.777912 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.762203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44074 (local address 127.30.73.65:41081)
0811 07:06:01.763167 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.763177 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.763663 (+ 486us) server_negotiation.cc:407] Connection header received
0811 07:06:01.763779 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.763786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.764047 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.764289 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:01.765604 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.768177 (+ 2573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.772077 (+ 3900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.774236 (+ 2159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.774415 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.774749 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.776971 (+ 2222us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.777246 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":555,"threads_started":1}
I20260811 07:06:01.783586 15210 tablet_service.cc:1467] Processing CreateTablet for tablet b86492cc5dfd4226a9b7643ed079377f (DEFAULT_TABLE table=test-table [id=31c87f683f5342f4a6d3fca24e7e181f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:06:01.784976 15210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b86492cc5dfd4226a9b7643ed079377f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:01.787911 15591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.763950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:42965 (local address 127.0.0.1:58116)
0811 07:06:01.778560 (+ 14610us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:01.778587 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:01.778726 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:01.779773 (+ 1047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:01.779781 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:01.779812 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:01.779994 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.780005 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.782836 (+ 2831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.782841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.785053 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.785088 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.787075 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.787085 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.787275 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.787309 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:06:01.787420 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:06:01.787574 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14466,"mutex_wait_us":96,"thread_start_us":13021,"threads_started":1}
I20260811 07:06:01.788545 15594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.763645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:37611 (local address 127.0.0.1:53356)
0811 07:06:01.776690 (+ 13045us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:01.776716 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:01.776871 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:01.780408 (+ 3537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:01.780412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:01.780436 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:01.780813 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.780828 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.782729 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.782734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.785179 (+ 2445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.785480 (+ 301us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.787454 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.787460 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.787654 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.787688 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:06:01.787800 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 07:06:01.787965 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12861,"mutex_wait_us":102,"thread_start_us":15567,"threads_started":1}
I20260811 07:06:01.788549 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.764240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53356 (local address 127.30.73.67:37611)
0811 07:06:01.779819 (+ 15579us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.779828 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.779862 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:06:01.779964 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.779971 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.780202 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.780406 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:01.781027 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.782568 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.785677 (+ 3109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.787015 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.787147 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.787377 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.787890 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.788198 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15272,"spinlock_wait_cycles":23808,"thread_start_us":15256,"threads_started":1}
I20260811 07:06:01.788800 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.764285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58116 (local address 127.30.73.66:42965)
0811 07:06:01.778843 (+ 14558us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.778855 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.778897 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:06:01.779025 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.779037 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.779371 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.779596 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:01.780151 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.782712 (+ 2561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.785278 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.786862 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.787017 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.787255 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.788235 (+ 980us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.788432 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14381,"thread_start_us":14250,"threads_started":1}
I20260811 07:06:01.792189 15509 tablet_service.cc:1467] Processing CreateTablet for tablet b86492cc5dfd4226a9b7643ed079377f (DEFAULT_TABLE table=test-table [id=31c87f683f5342f4a6d3fca24e7e181f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:06:01.792382 15362 tablet_service.cc:1467] Processing CreateTablet for tablet b86492cc5dfd4226a9b7643ed079377f (DEFAULT_TABLE table=test-table [id=31c87f683f5342f4a6d3fca24e7e181f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:06:01.793723 15362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b86492cc5dfd4226a9b7643ed079377f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:01.794020 15509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b86492cc5dfd4226a9b7643ed079377f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:01.802625 15597 tablet_bootstrap.cc:492] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: Bootstrap starting.
I20260811 07:06:01.806524 15597 tablet_bootstrap.cc:654] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:01.808084 15597 log.cc:824] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:01.808162 15598 tablet_bootstrap.cc:492] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: Bootstrap starting.
I20260811 07:06:01.810727 15599 tablet_bootstrap.cc:492] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: Bootstrap starting.
I20260811 07:06:01.812309 15598 tablet_bootstrap.cc:654] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:01.813512 15598 log.cc:824] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:01.814491 15599 tablet_bootstrap.cc:654] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:01.814693 15597 tablet_bootstrap.cc:492] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: No bootstrap required, opened a new log
I20260811 07:06:01.815099 15597 ts_tablet_manager.cc:1397] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260811 07:06:01.815956 15599 log.cc:824] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:01.816949 15598 tablet_bootstrap.cc:492] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: No bootstrap required, opened a new log
I20260811 07:06:01.817253 15598 ts_tablet_manager.cc:1397] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 07:06:01.819608 15599 tablet_bootstrap.cc:492] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: No bootstrap required, opened a new log
I20260811 07:06:01.819928 15599 ts_tablet_manager.cc:1397] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: Time spent bootstrapping tablet: real 0.009s user 0.009s sys 0.000s
I20260811 07:06:01.825111 15598 raft_consensus.cc:348] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } }
I20260811 07:06:01.825627 15598 raft_consensus.cc:374] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:01.825886 15598 raft_consensus.cc:729] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc95ee35715434e948385fa9198d42e, State: Initialized, Role: FOLLOWER
I20260811 07:06:01.826237 15597 raft_consensus.cc:348] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } }
I20260811 07:06:01.826669 15597 raft_consensus.cc:374] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:01.826779 15597 raft_consensus.cc:729] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b11e65c0fa4f4e1ea36e2b5875e98a98, State: Initialized, Role: FOLLOWER
I20260811 07:06:01.826624 15598 consensus_queue.cc:260] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } }
I20260811 07:06:01.827347 15597 consensus_queue.cc:260] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } }
I20260811 07:06:01.830040 15598 ts_tablet_manager.cc:1428] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
I20260811 07:06:01.830258 15597 ts_tablet_manager.cc:1428] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260811 07:06:01.830857 15581 heartbeater.cc:503] Master 127.30.73.126:44257 was elected leader, sending a full tablet report...
I20260811 07:06:01.831043 15599 raft_consensus.cc:348] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } }
I20260811 07:06:01.831518 15599 raft_consensus.cc:374] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:01.831653 15599 raft_consensus.cc:729] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ffea592c8b4727a3153d7e816a9e0d, State: Initialized, Role: FOLLOWER
I20260811 07:06:01.832289 15599 consensus_queue.cc:260] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } }
I20260811 07:06:01.833428 15435 heartbeater.cc:503] Master 127.30.73.126:44257 was elected leader, sending a full tablet report...
I20260811 07:06:01.834173 15599 ts_tablet_manager.cc:1428] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
W20260811 07:06:01.924556 15436 tablet.cc:2369] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:06:01.929890 15604 raft_consensus.cc:482] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:06:01.930215 15604 raft_consensus.cc:504] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } }
I20260811 07:06:01.931990 15604 leader_election.cc:288] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b11e65c0fa4f4e1ea36e2b5875e98a98 (127.30.73.65:41081), c6ffea592c8b4727a3153d7e816a9e0d (127.30.73.66:42965)
W20260811 07:06:01.936950 15582 tablet.cc:2369] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:06:01.938766 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.932746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:43817 (local address 127.30.73.65:41081)
0811 07:06:01.933027 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.933035 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.933343 (+ 308us) server_negotiation.cc:407] Connection header received
0811 07:06:01.933593 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.933600 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.933678 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.933747 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:01.934256 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.935076 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.936922 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.937787 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.937996 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.938089 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.938365 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.938494 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260811 07:06:01.938781 15583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.932208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:41081 (local address 127.30.73.67:43817)
0811 07:06:01.933218 (+ 1010us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:01.933238 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:01.933415 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:01.933802 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:01.933807 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:01.933856 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:01.934099 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.934108 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.935246 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.935252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.936753 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.936766 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.937985 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.937991 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.938197 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.938222 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:06:01.938331 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 07:06:01.938466 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"mutex_wait_us":1,"spinlock_wait_cycles":45824}
I20260811 07:06:01.939575 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.932541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:51933 (local address 127.30.73.66:42965)
0811 07:06:01.932809 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.932819 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.933438 (+ 619us) server_negotiation.cc:407] Connection header received
0811 07:06:01.933635 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.933639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.933704 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.933839 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:01.934511 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.935266 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.937306 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.938382 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.938782 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.938860 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.939169 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.939301 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:06:01.939688 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.932451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:42965 (local address 127.30.73.67:51933)
0811 07:06:01.933314 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:01.933336 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:01.933470 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:01.933892 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:01.933901 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:01.933941 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:01.934310 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.934325 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.935432 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.935436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.937104 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:01.937121 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.938818 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.938824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:01.938996 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.939028 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 07:06:01.939140 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 07:06:01.939287 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":24,"thread_start_us":475,"threads_started":1}
I20260811 07:06:01.940074 15230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b86492cc5dfd4226a9b7643ed079377f" candidate_uuid: "8fc95ee35715434e948385fa9198d42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" is_pre_election: true
I20260811 07:06:01.940677 15230 raft_consensus.cc:2454] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fc95ee35715434e948385fa9198d42e in term 0.
I20260811 07:06:01.940757 15383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b86492cc5dfd4226a9b7643ed079377f" candidate_uuid: "8fc95ee35715434e948385fa9198d42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" is_pre_election: true
I20260811 07:06:01.941246 15383 raft_consensus.cc:2454] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fc95ee35715434e948385fa9198d42e in term 0.
I20260811 07:06:01.941427 15460 leader_election.cc:302] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc95ee35715434e948385fa9198d42e, b11e65c0fa4f4e1ea36e2b5875e98a98; no voters:
I20260811 07:06:01.941870 15604 raft_consensus.cc:2781] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:06:01.942034 15604 raft_consensus.cc:482] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:06:01.942174 15604 raft_consensus.cc:3037] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:01.944618 15604 raft_consensus.cc:504] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } }
I20260811 07:06:01.945416 15604 leader_election.cc:288] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [CANDIDATE]: Term 1 election: Requested vote from peers b11e65c0fa4f4e1ea36e2b5875e98a98 (127.30.73.65:41081), c6ffea592c8b4727a3153d7e816a9e0d (127.30.73.66:42965)
I20260811 07:06:01.945976 15230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b86492cc5dfd4226a9b7643ed079377f" candidate_uuid: "8fc95ee35715434e948385fa9198d42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98"
I20260811 07:06:01.945989 15383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b86492cc5dfd4226a9b7643ed079377f" candidate_uuid: "8fc95ee35715434e948385fa9198d42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ffea592c8b4727a3153d7e816a9e0d"
I20260811 07:06:01.946213 15383 raft_consensus.cc:3037] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:01.946206 15230 raft_consensus.cc:3037] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:01.948494 15230 raft_consensus.cc:2454] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fc95ee35715434e948385fa9198d42e in term 1.
I20260811 07:06:01.948494 15383 raft_consensus.cc:2454] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fc95ee35715434e948385fa9198d42e in term 1.
I20260811 07:06:01.948963 15460 leader_election.cc:302] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 8fc95ee35715434e948385fa9198d42e, b11e65c0fa4f4e1ea36e2b5875e98a98, c6ffea592c8b4727a3153d7e816a9e0d; no voters:
I20260811 07:06:01.949311 15604 raft_consensus.cc:2781] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:06:01.949759 15604 raft_consensus.cc:686] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 1 LEADER]: Becoming Leader. State: Replica: 8fc95ee35715434e948385fa9198d42e, State: Running, Role: LEADER
I20260811 07:06:01.950328 15604 consensus_queue.cc:237] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } }
I20260811 07:06:01.955719 15073 catalog_manager.cc:5495] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fc95ee35715434e948385fa9198d42e (127.30.73.67). New cstate: current_term: 1 leader_uuid: "8fc95ee35715434e948385fa9198d42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fc95ee35715434e948385fa9198d42e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 } health_report { overall_health: UNKNOWN } } }
I20260811 07:06:01.983302 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:01.977664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53362 (local address 127.30.73.67:37611)
0811 07:06:01.977935 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:01.977942 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:01.977966 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:06:01.978090 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:01.978094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:01.978185 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:01.978360 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:06:01.978753 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.979495 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.981033 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:01.981459 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:01.981598 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:01.982177 (+ 579us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:06:01.982700 (+ 523us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:06:01.982875 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:01.982938 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 07:06:01.983020 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:06:01.991788 15230 raft_consensus.cc:1261] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 1 FOLLOWER]: Refusing update from remote peer 8fc95ee35715434e948385fa9198d42e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:06:01.991789 15383 raft_consensus.cc:1261] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [term 1 FOLLOWER]: Refusing update from remote peer 8fc95ee35715434e948385fa9198d42e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:06:01.992837 15609 consensus_queue.cc:1035] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 41081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:06:01.993176 15604 consensus_queue.cc:1035] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ffea592c8b4727a3153d7e816a9e0d" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 42965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:06:02.008594 15614 mvcc.cc:205] Tried to move back new op lower bound from 7317225316307861504 to 7317225316152590336. Current Snapshot: MvccSnapshot[applied={T|T < 7317225316307861504}]
I20260811 07:06:02.020874 15074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:42262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:06:02.021229 15074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:42262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:06:02.025463 15074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Sending DeleteTablet for 3 replicas of tablet b86492cc5dfd4226a9b7643ed079377f
I20260811 07:06:02.026970 15210 tablet_service.cc:1514] Processing DeleteTablet for tablet b86492cc5dfd4226a9b7643ed079377f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:06:02 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:44074
I20260811 07:06:02.027040 15509 tablet_service.cc:1514] Processing DeleteTablet for tablet b86492cc5dfd4226a9b7643ed079377f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:06:02 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:53356
I20260811 07:06:02.027077 15362 tablet_service.cc:1514] Processing DeleteTablet for tablet b86492cc5dfd4226a9b7643ed079377f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:06:02 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:58116
I20260811 07:06:02.031755 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 15114
I20260811 07:06:02.039875 15624 tablet_replica.cc:330] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: stopping tablet replica
I20260811 07:06:02.040614 15624 raft_consensus.cc:2229] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:06:02.041288 15624 raft_consensus.cc:2258] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:06:02.042332 15626 tablet_replica.cc:330] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: stopping tablet replica
I20260811 07:06:02.042369 15625 tablet_replica.cc:330] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: stopping tablet replica
I20260811 07:06:02.042815 15626 raft_consensus.cc:2229] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:06:02.042809 15625 raft_consensus.cc:2229] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:06:02.043339 15625 raft_consensus.cc:2258] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:06:02.043740 15626 raft_consensus.cc:2258] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:06:02.045717 15626 ts_tablet_manager.cc:1905] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:06:02.048269 15625 ts_tablet_manager.cc:1905] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:06:02.052376 15626 ts_tablet_manager.cc:1918] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:06:02.052554 15626 log.cc:1196] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/b86492cc5dfd4226a9b7643ed079377f
I20260811 07:06:02.053220 15626 ts_tablet_manager.cc:1939] T b86492cc5dfd4226a9b7643ed079377f P 8fc95ee35715434e948385fa9198d42e: Deleting consensus metadata
I20260811 07:06:02.054284 15624 ts_tablet_manager.cc:1905] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:06:02.055660 15060 catalog_manager.cc:4841] TS 8fc95ee35715434e948385fa9198d42e (127.30.73.67:37611): tablet b86492cc5dfd4226a9b7643ed079377f (table test-table [id=31c87f683f5342f4a6d3fca24e7e181f]) successfully deleted
I20260811 07:06:02.059150 15625 ts_tablet_manager.cc:1918] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:06:02.060775 15625 log.cc:1196] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/b86492cc5dfd4226a9b7643ed079377f
I20260811 07:06:02.060796 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:02.032803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44084 (local address 127.30.73.65:41081)
0811 07:06:02.033496 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:02.033503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:02.033522 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:06:02.033585 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:02.033591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:02.033731 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:02.033872 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:02.036297 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:02.037498 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:02.039708 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:02.040530 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:02.040677 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:02.045863 (+ 5186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:02.045882 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:02.045899 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:02.045956 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:02.049931 (+ 3975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:02.055202 (+ 5271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:02.055214 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:02.055217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:02.055479 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:02.056540 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:02.056549 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:02.056553 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:02.057084 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:02.057453 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:02.060037 (+ 2584us) server_negotiation.cc:299] Negotiation successful
0811 07:06:02.060336 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551}
I20260811 07:06:02.062033 15625 ts_tablet_manager.cc:1939] T b86492cc5dfd4226a9b7643ed079377f P c6ffea592c8b4727a3153d7e816a9e0d: Deleting consensus metadata
I20260811 07:06:02.062299 15624 ts_tablet_manager.cc:1918] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:06:02.062472 15624 log.cc:1196] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/b86492cc5dfd4226a9b7643ed079377f
I20260811 07:06:02.063033 15624 ts_tablet_manager.cc:1939] T b86492cc5dfd4226a9b7643ed079377f P b11e65c0fa4f4e1ea36e2b5875e98a98: Deleting consensus metadata
I20260811 07:06:02.064077 15059 catalog_manager.cc:4841] TS c6ffea592c8b4727a3153d7e816a9e0d (127.30.73.66:42965): tablet b86492cc5dfd4226a9b7643ed079377f (table test-table [id=31c87f683f5342f4a6d3fca24e7e181f]) successfully deleted
I20260811 07:06:02.064981 15060 catalog_manager.cc:4841] TS b11e65c0fa4f4e1ea36e2b5875e98a98 (127.30.73.65:41081): tablet b86492cc5dfd4226a9b7643ed079377f (table test-table [id=31c87f683f5342f4a6d3fca24e7e181f]) successfully deleted
I20260811 07:06:02.071946 15278 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:02.187208 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 15114
I20260811 07:06:02.218721 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 15289
I20260811 07:06:02.236311 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:02.219767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58122 (local address 127.30.73.66:42965)
0811 07:06:02.219984 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:02.219991 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:02.220013 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:06:02.220155 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:02.220161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:02.220268 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:02.220376 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:02.221853 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:02.223002 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:02.225308 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:02.226013 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:02.226152 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:02.229443 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:02.229460 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:02.229484 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:02.229530 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:02.233248 (+ 3718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:02.234091 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:02.234101 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:02.234105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:02.234258 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:02.234616 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:02.234621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:02.234624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:02.235124 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:02.235389 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:02.235720 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 07:06:02.235938 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:06:02.237141 15430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:02.329437 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 15289
I20260811 07:06:02.351094 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 15439
I20260811 07:06:02.368525 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:02.351995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.30.73.67:37611)
0811 07:06:02.352208 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:02.352214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:02.352237 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:06:02.352446 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:02.352452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:02.352566 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:02.352715 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:02.354220 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:02.355566 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:02.356979 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:02.357690 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:02.357883 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:02.360621 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:02.360637 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:02.360660 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:02.360705 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:02.364975 (+ 4270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:02.365874 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:02.365885 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:02.365888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:02.366139 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:02.366615 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:02.366627 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:02.366631 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:02.367170 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:02.367511 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:02.367848 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 07:06:02.368110 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:06:02.369498 15576 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:02.500178 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 15439
I20260811 07:06:02.529881 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 15039
I20260811 07:06:02.531186 15107 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:02.649360 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 15039
I20260811 07:06:02.676939 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44257
--webserver_interface=127.30.73.126
--webserver_port=36755
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44257
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:06:03.032456 15632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:03.032754 15632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:03.032914 15632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:03.040850 15632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:06:03.041002 15632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:03.041152 15632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:03.041254 15632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:06:03.041352 15632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:06:03.052826 15632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=36755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:03.054522 15632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:03.056121 15632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:03.068311 15639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:03.068387 15638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:03.068279 15641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:03.071465 15632 server_base.cc:1034] running on GCE node
I20260811 07:06:03.072273 15632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:03.073736 15632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:03.075014 15632 hybrid_clock.cc:648] HybridClock initialized: now 1786431963074952 us; error 50 us; skew 500 ppm
I20260811 07:06:03.075400 15632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:03 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:03.078817 15632 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:06:03.080530 15632 webserver.cc:460] Webserver started at http://127.30.73.126:36755/ using document root <none> and password file <none>
I20260811 07:06:03.081256 15632 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:03.081363 15632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:03.087266 15632 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:06:03.090315 15649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:03.091807 15632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:06:03.091991 15632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "1e3087016853467c8c5655413c39aa70"
format_stamp: "Formatted at 2026-08-11 07:05:56 on dist-test-slave-69rg"
server_key: "149d45b41861ac383d6063cd0ec2a8ff"
server_key_iv: "8977dc852f990519521b418bb03a59b7"
server_key_version: "encryptionkey@0"
I20260811 07:06:03.093025 15632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:03.113878 15632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:03.118405 15632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:03.118712 15632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:03.139329 15632 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:44257
I20260811 07:06:03.139350 15704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:44257 every 8 connection(s)
I20260811 07:06:03.141026 15632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:06:03.147876 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 15632
I20260811 07:06:03.148149 15705 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:06:03.148883 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:41081
--local_ip_for_outbound_sockets=127.30.73.65
--tserver_master_addrs=127.30.73.126:44257
--webserver_port=35823
--webserver_interface=127.30.73.65
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:06:03.151626 15705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Bootstrap starting.
I20260811 07:06:03.176582 15705 log.cc:824] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:03.193698 15705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:06:03.194368 15705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70: Bootstrap complete.
I20260811 07:06:03.204319 15705 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:06:03.205295 15705 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3087016853467c8c5655413c39aa70, State: Initialized, Role: FOLLOWER
I20260811 07:06:03.205969 15705 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:06:03.206238 15705 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:06:03.206377 15705 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:06:03.206559 15705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:06:03.210551 15705 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:06:03.211061 15705 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3087016853467c8c5655413c39aa70; no voters:
I20260811 07:06:03.211808 15705 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 07:06:03.211946 15711 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:06:03.213083 15711 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [term 3 LEADER]: Becoming Leader. State: Replica: 1e3087016853467c8c5655413c39aa70, State: Running, Role: LEADER
I20260811 07:06:03.213693 15711 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } }
I20260811 07:06:03.214145 15705 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:06:03.216351 15713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3087016853467c8c5655413c39aa70. Latest consensus state: current_term: 3 leader_uuid: "1e3087016853467c8c5655413c39aa70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } } }
I20260811 07:06:03.216804 15713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: This master's current role is: LEADER
I20260811 07:06:03.217442 15712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1e3087016853467c8c5655413c39aa70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3087016853467c8c5655413c39aa70" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44257 } } }
I20260811 07:06:03.217765 15712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3087016853467c8c5655413c39aa70 [sys.catalog]: This master's current role is: LEADER
I20260811 07:06:03.222463 15717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:06:03.231738 15717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:06:03.233356 15717 catalog_manager.cc:1259] Loaded cluster ID: cbd2c24efced423fbf3a7488e5468a17
I20260811 07:06:03.233498 15717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 07:06:03.235754 15717 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f63aa5059ad google::LogMessage::Fail() at ??:0
@ 0x7f63aa50888a google::LogMessage::SendToLog() at ??:0
@ 0x7f63aa5054de google::LogMessage::Flush() at ??:0
@ 0x7f63aa506a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f63bff38512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f63bff35976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f63bffbd610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f63bffbd439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f63ad151345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f63ad15491c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f63ad154799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f63ad12feaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f63b04096db start_thread at ??:0
@ 0x7f63a939f61f clone at ??:0
W20260811 07:06:03.605615 15707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:03.605986 15707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:03.606096 15707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:03.613392 15707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:03.613505 15707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:03.613619 15707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:06:03.623661 15707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:41081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=35823
--tserver_master_addrs=127.30.73.126:44257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:03.624953 15707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:03.626293 15707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:03.640965 15748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:03.641007 15749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:03.641048 15752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:03.642127 15707 server_base.cc:1034] running on GCE node
I20260811 07:06:03.642818 15707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:03.643886 15707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:03.645143 15707 hybrid_clock.cc:648] HybridClock initialized: now 1786431963645082 us; error 57 us; skew 500 ppm
I20260811 07:06:03.645480 15707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:03 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:03.648989 15707 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:06:03.650720 15707 webserver.cc:460] Webserver started at http://127.30.73.65:35823/ using document root <none> and password file <none>
I20260811 07:06:03.651485 15707 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:03.651648 15707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:03.657476 15707 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:06:03.660473 15759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:03.661940 15707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:06:03.662117 15707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "b11e65c0fa4f4e1ea36e2b5875e98a98"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "777bccc66b1eedca9d829dc689628fd8"
server_key_iv: "de8974a42c3093a621bcfe4bf5f26a92"
server_key_version: "encryptionkey@0"
I20260811 07:06:03.663182 15707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:03.679791 15707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:03.684216 15707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:03.684664 15707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:03.685767 15707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:03.687274 15707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:03.687402 15707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:03.687548 15707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:03.687664 15707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:03.723990 15707 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:41081
I20260811 07:06:03.724062 15891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:41081 every 8 connection(s)
I20260811 07:06:03.725536 15707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:06:03.730569 15894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:03.728612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:59795)
0811 07:06:03.729428 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:03.729649 (+ 221us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":346,"threads_started":1}
W20260811 07:06:03.731293 15892 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:44257 (0 consecutive failures): Network error: Failed to ping master at 127.30.73.126:44257: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
I20260811 07:06:03.732160 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 15707
I20260811 07:06:03.732200 15894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:03.731890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:41267)
0811 07:06:03.732035 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:03.732108 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 07:06:03.732842 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:42965
--local_ip_for_outbound_sockets=127.30.73.66
--tserver_master_addrs=127.30.73.126:44257
--webserver_port=37651
--webserver_interface=127.30.73.66
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:06:03.733163 15894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:03.732754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:46045)
0811 07:06:03.732897 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:03.733007 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 07:06:03.733378 15892 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:06:04.098850 15895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:04.099167 15895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:04.099279 15895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:04.107007 15895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:04.107159 15895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:04.107281 15895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:06:04.118352 15895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:42965
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=37651
--tserver_master_addrs=127.30.73.126:44257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:04.120042 15895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:04.121527 15895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:04.138019 15900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:04.138010 15901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:04.138311 15905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:04.139935 15895 server_base.cc:1034] running on GCE node
I20260811 07:06:04.140719 15895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:04.142089 15895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:04.143360 15895 hybrid_clock.cc:648] HybridClock initialized: now 1786431964143214 us; error 129 us; skew 500 ppm
I20260811 07:06:04.143750 15895 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:04 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:04.147501 15895 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:06:04.149219 15895 webserver.cc:460] Webserver started at http://127.30.73.66:37651/ using document root <none> and password file <none>
I20260811 07:06:04.150049 15895 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:04.150266 15895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:04.157505 15895 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:06:04.161228 15912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:04.163040 15895 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:06:04.163286 15895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "c6ffea592c8b4727a3153d7e816a9e0d"
format_stamp: "Formatted at 2026-08-11 07:05:57 on dist-test-slave-69rg"
server_key: "02f8bfe65ba8160cee1115d8c612b21d"
server_key_iv: "2f54b716ffe0241daecdb8709771ae9b"
server_key_version: "encryptionkey@0"
I20260811 07:06:04.164413 15895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:04.208556 15895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:04.213428 15895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:04.213764 15895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:04.214898 15895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:04.216409 15895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:04.216543 15895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:04.216676 15895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:04.216764 15895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:04.259852 15895 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:42965
I20260811 07:06:04.259907 16044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:42965 every 8 connection(s)
I20260811 07:06:04.261654 15895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:06:04.266054 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 15895
I20260811 07:06:04.267122 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:37611
--local_ip_for_outbound_sockets=127.30.73.67
--tserver_master_addrs=127.30.73.126:44257
--webserver_port=44459
--webserver_interface=127.30.73.67
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:06:04.267753 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:04.264876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:48519)
0811 07:06:04.266068 (+ 1192us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:04.266400 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":782,"thread_start_us":379,"threads_started":1}
W20260811 07:06:04.268767 16045 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:44257 (0 consecutive failures): Network error: Failed to ping master at 127.30.73.126:44257: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
I20260811 07:06:04.269925 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:04.269443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:49449)
0811 07:06:04.269651 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:04.269740 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 07:06:04.270834 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:04.270478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:37441)
0811 07:06:04.270632 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:04.270725 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 07:06:04.271104 16045 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:06:04.685210 16048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:04.685573 16048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:04.685690 16048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:04.693567 16048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:04.693713 16048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:04.693862 16048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:06:04.705152 16048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:37611
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=44459
--tserver_master_addrs=127.30.73.126:44257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:04.706768 16048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:04.708976 16048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:04.730443 16053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:04.730393 16054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:04.730458 16056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:04.731931 16048 server_base.cc:1034] running on GCE node
I20260811 07:06:04.732645 16048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:04.733863 16048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:04.734970 16059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:04.734110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:35847)
0811 07:06:04.734607 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:04.734725 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":243,"threads_started":1}
I20260811 07:06:04.735253 16048 hybrid_clock.cc:648] HybridClock initialized: now 1786431964735154 us; error 59 us; skew 500 ppm
I20260811 07:06:04.735638 16048 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:04 dist-test-slave-69rg krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:04.740608 16048 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:06:04.742718 16048 webserver.cc:460] Webserver started at http://127.30.73.67:44459/ using document root <none> and password file <none>
I20260811 07:06:04.743610 16048 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:04.743782 16048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:04.751358 16048 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:06:04.755105 16066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:04.757007 16048 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:06:04.757182 16048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "8fc95ee35715434e948385fa9198d42e"
format_stamp: "Formatted at 2026-08-11 07:05:58 on dist-test-slave-69rg"
server_key: "4233a93f562925632899a53a8ed60b17"
server_key_iv: "5d0830d9a5e7af139731407b4d05a06b"
server_key_version: "encryptionkey@0"
I20260811 07:06:04.758792 16048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:04.785292 16048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:04.791320 16048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:04.791633 16048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:04.792869 16048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:04.794498 16048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:04.794590 16048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:04.794729 16048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:04.794833 16048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:04.837059 16048 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:37611
I20260811 07:06:04.837117 16195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:37611 every 8 connection(s)
I20260811 07:06:04.838727 16048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:06:04.845410 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 16048
I20260811 07:06:04.846316 16198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:04.843723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:41961)
0811 07:06:04.844858 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:04.845126 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":781,"thread_start_us":478,"threads_started":1}
W20260811 07:06:04.847535 16196 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:44257 (0 consecutive failures): Network error: Failed to ping master at 127.30.73.126:44257: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
I20260811 07:06:04.848680 16198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:04.848298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:54527)
0811 07:06:04.848476 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:04.848554 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 07:06:04.850173 16198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:04.849604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:50397)
0811 07:06:04.849939 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:04.850036 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
W20260811 07:06:04.850564 16196 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:06:05.273264 16200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:05.272122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:34247)
0811 07:06:05.272815 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:05.272960 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":381,"threads_started":1}
I20260811 07:06:05.737586 16201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:05.736534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:36649)
0811 07:06:05.737235 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:05.737364 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":325,"threads_started":1}
I20260811 07:06:05.852759 16202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:05.851420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:50075)
0811 07:06:05.852288 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:05.852427 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":575,"threads_started":1}
I20260811 07:06:06.275837 16203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:06.274766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:60889)
0811 07:06:06.275455 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:06.275574 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":348,"threads_started":1}
I20260811 07:06:06.740154 16204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:06.739060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:45859)
0811 07:06:06.739754 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:06.739866 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":406,"threads_started":1}
I20260811 07:06:06.855595 16205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:06.854520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:47557)
0811 07:06:06.855241 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:06.855358 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":386,"threads_started":1}
I20260811 07:06:07.278477 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:07.277317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:56621)
0811 07:06:07.278090 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:07.278210 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":350,"threads_started":1}
I20260811 07:06:07.743219 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:07.741948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:47031)
0811 07:06:07.742767 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:07.742931 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":414,"threads_started":1}
I20260811 07:06:07.858294 16209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:07.857077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:43735)
0811 07:06:07.857785 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:07.858017 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":389,"threads_started":1}
I20260811 07:06:08.281280 16210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:08.280061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:53309)
0811 07:06:08.280935 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:08.281045 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":505,"threads_started":1}
I20260811 07:06:08.746418 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:08.745159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:45263)
0811 07:06:08.746055 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:08.746175 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":448,"threads_started":1}
I20260811 07:06:08.861445 16212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:08.860108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:48099)
0811 07:06:08.860960 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:08.861078 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":369,"threads_started":1}
I20260811 07:06:09.283623 16213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:09.282643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:34227)
0811 07:06:09.283267 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:09.283379 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":404,"threads_started":1}
I20260811 07:06:09.749063 16214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:09.747799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:58901)
0811 07:06:09.748667 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:09.748824 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":445,"threads_started":1}
I20260811 07:06:09.864260 16215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:09.863123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:46239)
0811 07:06:09.863864 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:09.864018 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":385,"threads_started":1}
I20260811 07:06:10.286836 16216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:10.285617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:42993)
0811 07:06:10.286327 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:10.286450 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":401,"threads_started":1}
I20260811 07:06:10.752352 16217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:10.750944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:37855)
0811 07:06:10.751866 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:10.752011 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":384,"threads_started":1}
I20260811 07:06:10.867365 16219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:10.866016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:52797)
0811 07:06:10.866875 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:10.867069 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":495,"threads_started":1}
I20260811 07:06:11.290019 16220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:11.288445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:35631)
0811 07:06:11.289540 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:11.289672 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":878,"thread_start_us":551,"threads_started":1}
I20260811 07:06:11.754796 16221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:11.753884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:47979)
0811 07:06:11.754454 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:11.754567 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":280,"threads_started":1}
I20260811 07:06:11.870263 16222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:11.869027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:43649)
0811 07:06:11.869924 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:11.870029 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":458,"threads_started":1}
I20260811 07:06:12.292542 16223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:12.291401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:36255)
0811 07:06:12.292071 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:12.292260 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":378,"threads_started":1}
I20260811 07:06:12.757686 16224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:12.756364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:43297)
0811 07:06:12.757318 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:12.757436 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":545,"threads_started":1}
I20260811 07:06:12.872979 16225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:12.871804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:58013)
0811 07:06:12.872616 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:12.872739 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":436,"threads_started":1}
I20260811 07:06:13.295631 16226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:13.294326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:42955)
0811 07:06:13.295155 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:13.295323 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":437,"threads_started":1}
I20260811 07:06:13.760289 16227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:13.759192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:42825)
0811 07:06:13.759877 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:13.760027 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":379,"threads_started":1}
I20260811 07:06:13.875403 16228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:13.874300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:59823)
0811 07:06:13.875042 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:13.875151 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":362,"threads_started":1}
I20260811 07:06:14.298300 16229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:14.297165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:56741)
0811 07:06:14.297889 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:14.298025 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":378,"threads_started":1}
I20260811 07:06:14.762936 16230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:14.761790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:37477)
0811 07:06:14.762460 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:14.762598 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":291,"threads_started":1}
I20260811 07:06:14.877759 16232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:14.876805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:50679)
0811 07:06:14.877383 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:14.877518 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":322,"threads_started":1}
I20260811 07:06:15.301050 16233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:15.299802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:34327)
0811 07:06:15.300589 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:15.300748 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":341,"threads_started":1}
I20260811 07:06:15.765300 16234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:15.764309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:60541)
0811 07:06:15.764941 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:15.765073 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":339,"threads_started":1}
I20260811 07:06:15.880246 16236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:15.879184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:56769)
0811 07:06:15.879869 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:15.880006 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":364,"threads_started":1}
I20260811 07:06:16.303416 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:16.302511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:44887)
0811 07:06:16.303096 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:16.303196 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":310,"threads_started":1}
I20260811 07:06:16.767993 16239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:16.766817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:48983)
0811 07:06:16.767585 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:16.767743 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":439,"threads_started":1}
I20260811 07:06:16.882496 16240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:16.881500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:59067)
0811 07:06:16.882180 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:16.882283 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":374,"threads_started":1}
I20260811 07:06:17.305975 16241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:17.304787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:58249)
0811 07:06:17.305467 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:17.305588 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":330,"threads_started":1}
I20260811 07:06:17.770525 16242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:17.769326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:52513)
0811 07:06:17.770045 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:17.770160 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":364,"threads_started":1}
I20260811 07:06:17.884636 16243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:17.883660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:37675)
0811 07:06:17.884257 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:17.884377 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":299,"threads_started":1}
I20260811 07:06:18.308198 16244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:18.307186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:48645)
0811 07:06:18.307788 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:18.307903 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":317,"threads_started":1}
I20260811 07:06:18.773203 16245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:18.772230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:60141)
0811 07:06:18.772819 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:18.772940 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":287,"threads_started":1}
I20260811 07:06:18.887283 16246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:18.886222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:45967)
0811 07:06:18.886875 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:18.886993 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":335,"threads_started":1}
I20260811 07:06:19.311004 16247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:19.310054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.66:46345)
0811 07:06:19.310629 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:19.310740 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":300,"threads_started":1}
I20260811 07:06:19.776103 16248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:19.774723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.65:39249)
0811 07:06:19.775614 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:19.775752 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":751,"thread_start_us":485,"threads_started":1}
I20260811 07:06:19.847800 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 15707
I20260811 07:06:19.871552 16249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:19.849272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53338 (local address 127.30.73.65:41081)
0811 07:06:19.850236 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:19.850265 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:19.850343 (+ 78us) server_negotiation.cc:407] Connection header received
0811 07:06:19.852343 (+ 2000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:19.852371 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:19.852959 (+ 588us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:19.853435 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:19.855337 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:19.856932 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:19.858435 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:19.859225 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:19.859463 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:19.862898 (+ 3435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:19.862909 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:19.862932 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:19.862985 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:19.867105 (+ 4120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:19.868038 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:19.868047 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:19.868057 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:19.868263 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:19.868693 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:19.868698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:19.868700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:19.869480 (+ 780us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:19.869926 (+ 446us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:19.870526 (+ 600us) server_negotiation.cc:299] Negotiation successful
0811 07:06:19.871151 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":408,"threads_started":1}
I20260811 07:06:19.873497 15887 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:19.890086 16252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:19.889000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44257 (local address 127.30.73.67:40063)
0811 07:06:19.889657 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:19.889789 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:44257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":350,"threads_started":1}
I20260811 07:06:19.971043 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 15707
I20260811 07:06:20.002409 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 15895
I20260811 07:06:20.029688 16253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:20.003965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58916 (local address 127.30.73.66:42965)
0811 07:06:20.004940 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:20.004960 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:20.005021 (+ 61us) server_negotiation.cc:407] Connection header received
0811 07:06:20.007739 (+ 2718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:20.007754 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:20.008338 (+ 584us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:20.008834 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:20.011666 (+ 2832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:20.013349 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:20.014976 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:20.015857 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:20.016119 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:20.020189 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:20.020200 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:20.020226 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:20.020309 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:20.024807 (+ 4498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:20.025917 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:20.025926 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:20.025936 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:20.026189 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:20.026712 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:20.026717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:20.026720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:20.027652 (+ 932us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:20.028056 (+ 404us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:20.028680 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 07:06:20.029315 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":449,"threads_started":1}
I20260811 07:06:20.031684 16039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:20.134027 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 15895
I20260811 07:06:20.163623 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 16048
I20260811 07:06:20.188766 16257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:20.165251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36278 (local address 127.30.73.67:37611)
0811 07:06:20.166185 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:20.166206 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:20.166267 (+ 61us) server_negotiation.cc:407] Connection header received
0811 07:06:20.168397 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:20.168412 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:20.169046 (+ 634us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:20.169494 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:20.171817 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:20.173530 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:20.175290 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:20.176258 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:20.176463 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:20.180425 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:20.180436 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:20.180462 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:20.180540 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:20.184412 (+ 3872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:20.185395 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:20.185404 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:20.185413 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:20.185675 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:20.186167 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:20.186171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:20.186173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:20.186934 (+ 761us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:20.187239 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:20.187801 (+ 562us) server_negotiation.cc:299] Negotiation successful
0811 07:06:20.188369 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":443,"threads_started":1}
I20260811 07:06:20.190650 16190 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:20.290784 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 16048
2026-08-11T07:06:20Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25450 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:06:20 dist-test-slave-69rg krb5kdc[16261](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:06:20 dist-test-slave-69rg krb5kdc[16261](info): set up 2 sockets
Aug 11 07:06:20 dist-test-slave-69rg krb5kdc[16261](info): commencing operation
krb5kdc: starting...
W20260811 07:06:21.574162 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.013s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:06:21 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:06:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:06:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:06:21.955964 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36239
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:36239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:06:22.355988 16274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:22.356448 16274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:22.356627 16274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:22.364620 16274 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:06:22.364778 16274 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:06:22.364876 16274 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:06:22.364979 16274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:06:22.365097 16274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:22.365235 16274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:22.365330 16274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:06:22.365414 16274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:06:22.377911 16274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:36239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:22.380337 16274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:22.382884 16274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:22.399524 16280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:22.399369 16281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:22.399464 16284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:22.400274 16274 server_base.cc:1034] running on GCE node
I20260811 07:06:22.401404 16274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:22.403580 16274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:22.404901 16274 hybrid_clock.cc:648] HybridClock initialized: now 1786431982404823 us; error 50 us; skew 500 ppm
I20260811 07:06:22.405396 16274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:22 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431982, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:22.410374 16274 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:06:22.412622 16274 webserver.cc:460] Webserver started at http://127.30.73.126:33167/ using document root <none> and password file <none>
I20260811 07:06:22.413668 16274 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:22.413829 16274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:22.414327 16274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:06:22.418691 16274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "bc42e23ce67641dda8a338e91fea665f"
format_stamp: "Formatted at 2026-08-11 07:06:22 on dist-test-slave-69rg"
server_key: "481608a6c168b0fb68c66282f440ad19"
server_key_iv: "cf74e3a820069f7b53f93a1611fcf174"
server_key_version: "encryptionkey@0"
I20260811 07:06:22.420020 16274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "bc42e23ce67641dda8a338e91fea665f"
format_stamp: "Formatted at 2026-08-11 07:06:22 on dist-test-slave-69rg"
server_key: "481608a6c168b0fb68c66282f440ad19"
server_key_iv: "cf74e3a820069f7b53f93a1611fcf174"
server_key_version: "encryptionkey@0"
I20260811 07:06:22.430136 16274 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.011s sys 0.001s
I20260811 07:06:22.435940 16293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:22.438026 16274 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:06:22.438269 16274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "bc42e23ce67641dda8a338e91fea665f"
format_stamp: "Formatted at 2026-08-11 07:06:22 on dist-test-slave-69rg"
server_key: "481608a6c168b0fb68c66282f440ad19"
server_key_iv: "cf74e3a820069f7b53f93a1611fcf174"
server_key_version: "encryptionkey@0"
I20260811 07:06:22.438640 16274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:22.460325 16274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:22.467353 16274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:22.467767 16274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:22.491035 16274 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:36239
I20260811 07:06:22.491050 16354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:36239 every 8 connection(s)
I20260811 07:06:22.492873 16274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:06:22.497913 16355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:22.502213 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 16274
I20260811 07:06:22.502491 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:06:22.503255 31013 external_mini_cluster.cc:1428] Setting key 623c228ceb429ad142ec48a8de6a8733
I20260811 07:06:22.514314 16355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Bootstrap starting.
I20260811 07:06:22.519203 16355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:22.520571 16355 log.cc:824] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:06:22 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:22.524501 16355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: No bootstrap required, opened a new log
I20260811 07:06:22.534763 16360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:22.505996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45014 (local address 127.30.73.126:36239)
0811 07:06:22.506962 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:22.506981 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:22.507051 (+ 70us) server_negotiation.cc:407] Connection header received
0811 07:06:22.509080 (+ 2029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:22.509122 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:22.509849 (+ 727us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:22.510425 (+ 576us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:22.512170 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:22.514465 (+ 2295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:22.516506 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:22.517715 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:22.517983 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:22.523590 (+ 5607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:22.523600 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:22.523620 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:22.523666 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:22.528023 (+ 4357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:22.529294 (+ 1271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:22.529306 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:22.529330 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:22.529618 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:22.530275 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:22.530282 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:22.530288 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:22.531479 (+ 1191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:22.531900 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:22.532566 (+ 666us) server_negotiation.cc:299] Negotiation successful
0811 07:06:22.533222 (+ 656us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":412,"threads_started":1}
I20260811 07:06:22.534611 16355 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:06:22.535212 16355 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:22.535324 16355 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc42e23ce67641dda8a338e91fea665f, State: Initialized, Role: FOLLOWER
I20260811 07:06:22.535996 16355 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:06:22.536633 16355 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:06:22.536868 16355 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:06:22.537158 16355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:22.541268 16355 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:06:22.542140 16355 leader_election.cc:302] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc42e23ce67641dda8a338e91fea665f; no voters:
I20260811 07:06:22.543041 16355 leader_election.cc:288] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:06:22.543277 16362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:06:22.544909 16362 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 1 LEADER]: Becoming Leader. State: Replica: bc42e23ce67641dda8a338e91fea665f, State: Running, Role: LEADER
I20260811 07:06:22.545720 16362 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:06:22.546356 16355 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:06:22.550274 16363 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc42e23ce67641dda8a338e91fea665f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } } }
I20260811 07:06:22.550946 16363 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: This master's current role is: LEADER
I20260811 07:06:22.551614 16364 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc42e23ce67641dda8a338e91fea665f. Latest consensus state: current_term: 1 leader_uuid: "bc42e23ce67641dda8a338e91fea665f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } } }
I20260811 07:06:22.552099 16364 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: This master's current role is: LEADER
I20260811 07:06:22.554419 16370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:06:22.562557 16370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:06:22.579180 16370 catalog_manager.cc:1347] Generated new cluster ID: e3c7c6c2eea54130ad8fbe546dfc9ba3
I20260811 07:06:22.579398 16370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:06:22.606804 16370 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:06:22.609519 16370 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:06:22.626312 16370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Generated new TSK 0
I20260811 07:06:22.627975 16370 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:06:22.739418 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36239
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:06:23.248342 16386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:23.248864 16386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:23.249085 16386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:23.258490 16386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:23.258747 16386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:23.258980 16386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:06:23.271082 16386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:23.273113 16386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:23.275111 16386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:23.297737 16392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:23.298173 16393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:23.298298 16395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:23.299083 16386 server_base.cc:1034] running on GCE node
I20260811 07:06:23.299963 16386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:23.301587 16386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:23.302889 16386 hybrid_clock.cc:648] HybridClock initialized: now 1786431983302796 us; error 115 us; skew 500 ppm
I20260811 07:06:23.303370 16386 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:23 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431983, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:23.324954 16386 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:06:23.327350 16386 webserver.cc:460] Webserver started at http://127.30.73.65:44461/ using document root <none> and password file <none>
I20260811 07:06:23.328325 16386 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:23.328465 16386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:23.328820 16386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:06:23.332793 16386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "93c2d47f822a498bad23e95f8d463f83"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "075911c749d6373ede29fd9510e0e4fe"
server_key_iv: "a3188f9e7995d1b1f09d6b63daf8d48c"
server_key_version: "encryptionkey@0"
I20260811 07:06:23.333875 16386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "93c2d47f822a498bad23e95f8d463f83"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "075911c749d6373ede29fd9510e0e4fe"
server_key_iv: "a3188f9e7995d1b1f09d6b63daf8d48c"
server_key_version: "encryptionkey@0"
I20260811 07:06:23.341552 16386 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260811 07:06:23.346633 16403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:23.348840 16386 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:06:23.349105 16386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "93c2d47f822a498bad23e95f8d463f83"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "075911c749d6373ede29fd9510e0e4fe"
server_key_iv: "a3188f9e7995d1b1f09d6b63daf8d48c"
server_key_version: "encryptionkey@0"
I20260811 07:06:23.349370 16386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:23.381537 16386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:23.389665 16386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:23.390295 16386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:23.391834 16386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:23.393796 16386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:23.393927 16386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 07:06:23.394075 16386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:23.394150 16386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:23.436530 16386 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:35709
I20260811 07:06:23.436582 16533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:35709 every 8 connection(s)
I20260811 07:06:23.437944 16386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:06:23.444937 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 16386
I20260811 07:06:23.445197 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:06:23.446182 31013 external_mini_cluster.cc:1428] Setting key 2d733bed63fc1d14f403d7bf3acaced4
Aug 11 07:06:23 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431983, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:23.464162 16537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:23.440863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:37597 (local address 127.30.73.126:36239)
0811 07:06:23.441381 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:23.441386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:23.442538 (+ 1152us) server_negotiation.cc:407] Connection header received
0811 07:06:23.444743 (+ 2205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:23.444748 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:23.444827 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:23.444921 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:23.447246 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:23.448561 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:23.451186 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:23.451617 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:23.451735 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:23.457147 (+ 5412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:23.457153 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:23.457157 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:23.457198 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:23.460234 (+ 3036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:23.461447 (+ 1213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:23.461453 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:23.461455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:23.461598 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:23.462195 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:23.462205 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:23.462207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:23.462520 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:23.462692 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:23.463472 (+ 780us) server_negotiation.cc:299] Negotiation successful
0811 07:06:23.463729 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":387,"thread_start_us":251,"threads_started":1}
I20260811 07:06:23.465205 16538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:23.441544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:37597)
0811 07:06:23.442365 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:23.442406 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:23.444360 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:23.445255 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:23.445269 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:23.446153 (+ 884us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:06:23.447031 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:23.447054 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:23.448726 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:23.448734 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:23.450961 (+ 2227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:23.450982 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:23.451887 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:23.451896 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:23.452231 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:23.453101 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:06:23.453138 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:06:23.456831 (+ 3693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:06:23.460424 (+ 3593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:23.460434 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:23.460453 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:23.461280 (+ 827us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:23.461763 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:23.461768 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:23.461772 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:23.462048 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:23.462665 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:06:23.462674 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:06:23.463052 (+ 378us) client_negotiation.cc:769] Sending connection context
0811 07:06:23.463342 (+ 290us) client_negotiation.cc:240] Negotiation successful
0811 07:06:23.463921 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":335,"threads_started":1}
I20260811 07:06:23.467285 16534 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36239
I20260811 07:06:23.467618 16534 heartbeater.cc:464] Registering TS with master...
I20260811 07:06:23.468398 16534 heartbeater.cc:511] Master 127.30.73.126:36239 requested a full tablet report, sending...
I20260811 07:06:23.471057 16316 ts_manager.cc:194] Registered new tserver with Master: 93c2d47f822a498bad23e95f8d463f83 (127.30.73.65:35709)
I20260811 07:06:23.473644 16316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:37597
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:06:23.531069 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36239
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:06:23.914227 16541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:23.914521 16541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:23.914762 16541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:23.922401 16541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:23.922533 16541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:23.922746 16541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:06:23.932936 16541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:23.934422 16541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:23.935802 16541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:23.950335 16547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:23.950402 16548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:23.950573 16550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:23.951637 16541 server_base.cc:1034] running on GCE node
I20260811 07:06:23.952346 16541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:23.953459 16541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:23.954728 16541 hybrid_clock.cc:648] HybridClock initialized: now 1786431983954688 us; error 50 us; skew 500 ppm
I20260811 07:06:23.955157 16541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:23 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431983, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:23.958743 16541 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:06:23.960294 16541 webserver.cc:460] Webserver started at http://127.30.73.66:35689/ using document root <none> and password file <none>
I20260811 07:06:23.961026 16541 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:23.961186 16541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:23.961519 16541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:06:23.964766 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "5d1cc410ce164b7a9bacd3e74851a975"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "8463432c7977b0cdd65b576db1993240"
server_key_iv: "4801d5e8ec816b280bdcc55c174453bc"
server_key_version: "encryptionkey@0"
I20260811 07:06:23.965791 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "5d1cc410ce164b7a9bacd3e74851a975"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "8463432c7977b0cdd65b576db1993240"
server_key_iv: "4801d5e8ec816b280bdcc55c174453bc"
server_key_version: "encryptionkey@0"
I20260811 07:06:23.971410 16541 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:06:23.975482 16558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:23.976963 16541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:06:23.977165 16541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "5d1cc410ce164b7a9bacd3e74851a975"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "8463432c7977b0cdd65b576db1993240"
server_key_iv: "4801d5e8ec816b280bdcc55c174453bc"
server_key_version: "encryptionkey@0"
I20260811 07:06:23.977376 16541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:24.002142 16541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:24.006908 16541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:24.007256 16541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:24.008469 16541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:24.010035 16541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:24.010119 16541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:24.010289 16541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:24.010342 16541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:24.046629 16541 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:36769
I20260811 07:06:24.046720 16684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:36769 every 8 connection(s)
I20260811 07:06:24.048164 16541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:06:24.054813 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 16541
I20260811 07:06:24.055088 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:06:24.055663 31013 external_mini_cluster.cc:1428] Setting key ae496906535d9ae7fc717d479bb3186a
Aug 11 07:06:24 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431983, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:24.073770 16688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.051011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:56011 (local address 127.30.73.126:36239)
0811 07:06:24.051534 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.051539 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.052351 (+ 812us) server_negotiation.cc:407] Connection header received
0811 07:06:24.054464 (+ 2113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.054469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.054565 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.054695 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:24.056379 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.057141 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.058986 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.059776 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.059952 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.065151 (+ 5199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:24.065163 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:24.065172 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:24.065222 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:24.069683 (+ 4461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:24.070911 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:24.070916 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:24.070926 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:24.071068 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:24.071720 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:24.071728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:24.071734 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:24.072193 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:24.072414 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.073210 (+ 796us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.073491 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":284,"threads_started":1}
I20260811 07:06:24.075304 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.051458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:56011)
0811 07:06:24.052186 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:24.052223 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:24.054133 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:24.054943 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:24.054951 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:24.055574 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:06:24.056143 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.056161 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.057326 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.057331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.058830 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.058843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.060128 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.060141 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.060524 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.061376 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:06:24.061411 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:06:24.064884 (+ 3473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:06:24.069943 (+ 5059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:24.069958 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:24.069982 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:24.070721 (+ 739us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:24.071201 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:24.071210 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:24.071216 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:24.071504 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:24.072371 (+ 867us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:06:24.072379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:06:24.072769 (+ 390us) client_negotiation.cc:769] Sending connection context
0811 07:06:24.073028 (+ 259us) client_negotiation.cc:240] Negotiation successful
0811 07:06:24.073679 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":290,"threads_started":1}
I20260811 07:06:24.076958 16685 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36239
I20260811 07:06:24.077360 16685 heartbeater.cc:464] Registering TS with master...
I20260811 07:06:24.078260 16685 heartbeater.cc:511] Master 127.30.73.126:36239 requested a full tablet report, sending...
I20260811 07:06:24.079954 16316 ts_manager.cc:194] Registered new tserver with Master: 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769)
I20260811 07:06:24.080895 16316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:56011
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:06:24.130067 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36239
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:06:24.478045 16534 heartbeater.cc:503] Master 127.30.73.126:36239 was elected leader, sending a full tablet report...
W20260811 07:06:24.505424 16692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:24.505833 16692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:24.506018 16692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:24.513523 16692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:24.513690 16692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:24.513931 16692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:06:24.524106 16692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:36239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:24.525535 16692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:24.526932 16692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:24.541482 16700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:24.541662 16698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:24.541451 16697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:24.542182 16692 server_base.cc:1034] running on GCE node
I20260811 07:06:24.542853 16692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:24.543995 16692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:24.545225 16692 hybrid_clock.cc:648] HybridClock initialized: now 1786431984545169 us; error 56 us; skew 500 ppm
I20260811 07:06:24.545571 16692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:24 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431984, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:24.549028 16692 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:06:24.550827 16692 webserver.cc:460] Webserver started at http://127.30.73.67:37613/ using document root <none> and password file <none>
I20260811 07:06:24.551574 16692 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:24.551735 16692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:24.552062 16692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:06:24.555615 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "b7fa9a15bb5c473c8c716a68274da658"
format_stamp: "Formatted at 2026-08-11 07:06:24 on dist-test-slave-69rg"
server_key: "fa3d609fdabe4d9d3c0ae289ed3abc3f"
server_key_iv: "008a7b4f0a530b2287946c2c1535367c"
server_key_version: "encryptionkey@0"
I20260811 07:06:24.556468 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "b7fa9a15bb5c473c8c716a68274da658"
format_stamp: "Formatted at 2026-08-11 07:06:24 on dist-test-slave-69rg"
server_key: "fa3d609fdabe4d9d3c0ae289ed3abc3f"
server_key_iv: "008a7b4f0a530b2287946c2c1535367c"
server_key_version: "encryptionkey@0"
I20260811 07:06:24.562314 16692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:06:24.566061 16707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:24.567412 16692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:06:24.567615 16692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "b7fa9a15bb5c473c8c716a68274da658"
format_stamp: "Formatted at 2026-08-11 07:06:24 on dist-test-slave-69rg"
server_key: "fa3d609fdabe4d9d3c0ae289ed3abc3f"
server_key_iv: "008a7b4f0a530b2287946c2c1535367c"
server_key_version: "encryptionkey@0"
I20260811 07:06:24.567857 16692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:24.582831 16692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:24.587188 16692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:24.587455 16692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:24.588415 16692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:24.589920 16692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:24.589999 16692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:24.590090 16692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:24.590138 16692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:24.626298 16692 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:41755
I20260811 07:06:24.626334 16846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:41755 every 8 connection(s)
I20260811 07:06:24.627633 16692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:06:24.633674 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 16692
I20260811 07:06:24.633936 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:06:24.634447 31013 external_mini_cluster.cc:1428] Setting key d0174ab5f09467b71620c8a3c7109615
Aug 11 07:06:24 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431984, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:24.652136 16849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.630513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:43463 (local address 127.30.73.126:36239)
0811 07:06:24.631086 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.631091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.632011 (+ 920us) server_negotiation.cc:407] Connection header received
0811 07:06:24.634177 (+ 2166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.634183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.634306 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.634445 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:24.636511 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.637497 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.639416 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.639863 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.640015 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.645066 (+ 5051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:24.645073 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:24.645076 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:24.645235 (+ 159us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:24.648409 (+ 3174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:24.649302 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:24.649307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:24.649309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:24.649492 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:24.650229 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:24.650235 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:24.650237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:24.650560 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:24.650696 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.651615 (+ 919us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.651810 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":316,"threads_started":1}
I20260811 07:06:24.653126 16850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.630992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:43463)
0811 07:06:24.631814 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:24.631854 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:24.633739 (+ 1885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:24.634742 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:24.634752 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:24.635522 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:06:24.636315 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.636340 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.637709 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.637726 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.639241 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.639257 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.640125 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.640133 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.640395 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.641172 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:06:24.641198 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:06:24.644775 (+ 3577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:06:24.648585 (+ 3810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:24.648597 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:24.648616 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:24.649144 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:24.649653 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:24.649657 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:24.649659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:24.650016 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:24.650703 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:06:24.650713 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:06:24.651201 (+ 488us) client_negotiation.cc:769] Sending connection context
0811 07:06:24.651466 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 07:06:24.651912 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":302,"threads_started":1}
I20260811 07:06:24.654798 16847 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36239
I20260811 07:06:24.655220 16847 heartbeater.cc:464] Registering TS with master...
I20260811 07:06:24.656060 16847 heartbeater.cc:511] Master 127.30.73.126:36239 requested a full tablet report, sending...
I20260811 07:06:24.657703 16316 ts_manager.cc:194] Registered new tserver with Master: b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755)
I20260811 07:06:24.658608 16316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:43463
I20260811 07:06:24.663966 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:06:24.684386 16849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.670464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45026 (local address 127.30.73.126:36239)
0811 07:06:24.670682 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.670690 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.671083 (+ 393us) server_negotiation.cc:407] Connection header received
0811 07:06:24.671309 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.671314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.671430 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.671541 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:24.673173 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.673985 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.675420 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.675845 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.675979 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.678644 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:24.678649 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:24.678652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:24.678692 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:24.681263 (+ 2571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:24.682146 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:24.682154 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:24.682158 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:24.682300 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:24.682716 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:24.682727 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:24.682767 (+ 40us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:24.683189 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:24.683452 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.683807 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.684042 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:06:24.688952 16316 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:06:24.696276 16316 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:06:24.723313 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.710458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.30.73.67:41755)
0811 07:06:24.714129 (+ 3671us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.714135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.714160 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:06:24.714250 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.714255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.714482 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.715181 (+ 699us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:24.716115 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.717970 (+ 1855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.720610 (+ 2640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.722032 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.722167 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.722422 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.722761 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.722942 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3533,"thread_start_us":1064,"threads_started":1}
I20260811 07:06:24.723381 16862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.710117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41755 (local address 127.0.0.1:34392)
0811 07:06:24.712430 (+ 2313us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:24.712454 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:24.712569 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:24.714728 (+ 2159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:24.714735 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:24.714760 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:24.715819 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.715844 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.718130 (+ 2286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.718138 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.720436 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.720452 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.722278 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.722285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.722487 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.722540 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 07:06:24.722693 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 07:06:24.722918 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2179,"mutex_wait_us":33,"thread_start_us":783,"threads_started":1}
I20260811 07:06:24.724249 16863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.709972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:53448)
0811 07:06:24.710963 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:24.711030 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:24.711223 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:24.714424 (+ 3201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:24.714431 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:24.714462 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:24.715778 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.715796 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.717441 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.717449 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.720270 (+ 2821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.720283 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.722583 (+ 2300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.722588 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.722801 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.722879 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 07:06:24.722968 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 07:06:24.723112 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"mutex_wait_us":59,"thread_start_us":2196,"threads_started":1}
I20260811 07:06:24.724922 16865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.710662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53448 (local address 127.30.73.65:35709)
0811 07:06:24.713541 (+ 2879us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.713554 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.713605 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:06:24.713748 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.713760 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.714144 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.714404 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:24.716039 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.717290 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.720435 (+ 3145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.722027 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.722167 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.722426 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.724467 (+ 2041us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.724635 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2654,"thread_start_us":2476,"threads_started":1}
I20260811 07:06:24.726161 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.711733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:36769 (local address 127.0.0.1:39026)
0811 07:06:24.717845 (+ 6112us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:24.717877 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:24.718008 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:24.718749 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:24.718754 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:24.718781 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:24.719420 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.719434 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.721118 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.721123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.722858 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.722872 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.725276 (+ 2404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.725283 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.725469 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.725500 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:06:24.725597 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 07:06:24.725738 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5937,"mutex_wait_us":3,"thread_start_us":5700,"threads_started":1}
I20260811 07:06:24.727268 16868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.712013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39026 (local address 127.30.73.66:36769)
0811 07:06:24.713107 (+ 1094us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.713116 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.718000 (+ 4884us) server_negotiation.cc:407] Connection header received
0811 07:06:24.718248 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.718258 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.718525 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.718729 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:24.719650 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.720979 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.723040 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.724938 (+ 1898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.726513 (+ 1575us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.726714 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.726780 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.726954 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":930,"thread_start_us":775,"threads_started":1}
I20260811 07:06:24.728057 16770 tablet_service.cc:1467] Processing CreateTablet for tablet 1882d5ae065148cf828420d8987a3820 (DEFAULT_TABLE table=test-table [id=0d94d181e4224948ad91fe3416dc8448]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:06:24.728159 16458 tablet_service.cc:1467] Processing CreateTablet for tablet 1882d5ae065148cf828420d8987a3820 (DEFAULT_TABLE table=test-table [id=0d94d181e4224948ad91fe3416dc8448]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:06:24.729760 16770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1882d5ae065148cf828420d8987a3820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:24.729756 16458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1882d5ae065148cf828420d8987a3820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:24.730731 16607 tablet_service.cc:1467] Processing CreateTablet for tablet 1882d5ae065148cf828420d8987a3820 (DEFAULT_TABLE table=test-table [id=0d94d181e4224948ad91fe3416dc8448]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:06:24.732324 16607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1882d5ae065148cf828420d8987a3820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:24.743852 16869 tablet_bootstrap.cc:492] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: Bootstrap starting.
I20260811 07:06:24.746958 16870 tablet_bootstrap.cc:492] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: Bootstrap starting.
I20260811 07:06:24.747768 16869 tablet_bootstrap.cc:654] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:24.748891 16871 tablet_bootstrap.cc:492] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: Bootstrap starting.
I20260811 07:06:24.749239 16869 log.cc:824] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:24.751597 16870 tablet_bootstrap.cc:654] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:24.752612 16871 tablet_bootstrap.cc:654] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:24.753777 16870 log.cc:824] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:24.753873 16871 log.cc:824] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:24.757220 16869 tablet_bootstrap.cc:492] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: No bootstrap required, opened a new log
I20260811 07:06:24.757530 16869 ts_tablet_manager.cc:1397] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.003s
I20260811 07:06:24.757588 16870 tablet_bootstrap.cc:492] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: No bootstrap required, opened a new log
I20260811 07:06:24.757586 16871 tablet_bootstrap.cc:492] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: No bootstrap required, opened a new log
I20260811 07:06:24.757889 16870 ts_tablet_manager.cc:1397] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260811 07:06:24.757879 16871 ts_tablet_manager.cc:1397] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260811 07:06:24.766083 16869 raft_consensus.cc:348] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } }
I20260811 07:06:24.766623 16869 raft_consensus.cc:374] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:24.766750 16869 raft_consensus.cc:729] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7fa9a15bb5c473c8c716a68274da658, State: Initialized, Role: FOLLOWER
I20260811 07:06:24.767462 16869 consensus_queue.cc:260] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } }
I20260811 07:06:24.768734 16847 heartbeater.cc:503] Master 127.30.73.126:36239 was elected leader, sending a full tablet report...
I20260811 07:06:24.769279 16869 ts_tablet_manager.cc:1428] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260811 07:06:24.768994 16871 raft_consensus.cc:348] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } }
I20260811 07:06:24.769423 16871 raft_consensus.cc:374] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:24.769537 16871 raft_consensus.cc:729] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1cc410ce164b7a9bacd3e74851a975, State: Initialized, Role: FOLLOWER
I20260811 07:06:24.770195 16871 consensus_queue.cc:260] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } }
I20260811 07:06:24.770891 16870 raft_consensus.cc:348] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } }
I20260811 07:06:24.771328 16870 raft_consensus.cc:374] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:24.771399 16685 heartbeater.cc:503] Master 127.30.73.126:36239 was elected leader, sending a full tablet report...
I20260811 07:06:24.771445 16870 raft_consensus.cc:729] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93c2d47f822a498bad23e95f8d463f83, State: Initialized, Role: FOLLOWER
I20260811 07:06:24.772107 16870 consensus_queue.cc:260] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } }
I20260811 07:06:24.773077 16871 ts_tablet_manager.cc:1428] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: Time spent starting tablet: real 0.015s user 0.008s sys 0.006s
I20260811 07:06:24.773873 16877 raft_consensus.cc:482] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:06:24.774190 16877 raft_consensus.cc:504] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } }
I20260811 07:06:24.775488 16870 ts_tablet_manager.cc:1428] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: Time spent starting tablet: real 0.017s user 0.005s sys 0.008s
I20260811 07:06:24.779211 16877 leader_election.cc:288] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93c2d47f822a498bad23e95f8d463f83 (127.30.73.65:35709), 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769)
I20260811 07:06:24.785969 16868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.778380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:58609 (local address 127.30.73.66:36769)
0811 07:06:24.778745 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.778754 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.778950 (+ 196us) server_negotiation.cc:407] Connection header received
0811 07:06:24.779177 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.779183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.779270 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.779387 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:24.780378 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.781398 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.783866 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.784935 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.785149 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.785236 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.785540 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.785682 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197}
I20260811 07:06:24.786001 16850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.778482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:36769 (local address 127.30.73.67:58609)
0811 07:06:24.778864 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:24.778886 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:24.779013 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:24.779860 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:24.779865 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:24.779898 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:24.780122 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.780131 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.781603 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.781607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.783687 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.783703 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.785128 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.785134 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.785361 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.785391 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:06:24.785487 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:06:24.785593 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":1}
I20260811 07:06:24.786832 16865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.779228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:36057 (local address 127.30.73.65:35709)
0811 07:06:24.779764 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.779770 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.780267 (+ 497us) server_negotiation.cc:407] Connection header received
0811 07:06:24.780403 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.780407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.780489 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.780586 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:24.781141 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.782151 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.784389 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.785591 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.785757 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.785868 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.786516 (+ 648us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.786662 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353}
I20260811 07:06:24.787017 16881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.778496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.30.73.67:36057)
0811 07:06:24.780127 (+ 1631us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:24.780160 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:24.780292 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:24.780626 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:24.780629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:24.780655 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:24.780972 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.780980 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.782329 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.782335 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.784208 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:24.784219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.785904 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.785910 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:24.786312 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.786359 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 07:06:24.786455 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:06:24.786554 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1482,"mutex_wait_us":30,"thread_start_us":1204,"threads_started":1}
I20260811 07:06:24.787180 16630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1882d5ae065148cf828420d8987a3820" candidate_uuid: "b7fa9a15bb5c473c8c716a68274da658" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1cc410ce164b7a9bacd3e74851a975" is_pre_election: true
I20260811 07:06:24.787794 16630 raft_consensus.cc:2454] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7fa9a15bb5c473c8c716a68274da658 in term 0.
I20260811 07:06:24.787936 16481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1882d5ae065148cf828420d8987a3820" candidate_uuid: "b7fa9a15bb5c473c8c716a68274da658" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93c2d47f822a498bad23e95f8d463f83" is_pre_election: true
I20260811 07:06:24.788501 16481 raft_consensus.cc:2454] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7fa9a15bb5c473c8c716a68274da658 in term 0.
I20260811 07:06:24.788631 16713 leader_election.cc:302] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1cc410ce164b7a9bacd3e74851a975, b7fa9a15bb5c473c8c716a68274da658; no voters:
I20260811 07:06:24.789098 16877 raft_consensus.cc:2781] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:06:24.789243 16877 raft_consensus.cc:482] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:06:24.789382 16877 raft_consensus.cc:3037] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:24.791846 16877 raft_consensus.cc:504] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } }
I20260811 07:06:24.792752 16877 leader_election.cc:288] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [CANDIDATE]: Term 1 election: Requested vote from peers 93c2d47f822a498bad23e95f8d463f83 (127.30.73.65:35709), 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769)
I20260811 07:06:24.793308 16630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1882d5ae065148cf828420d8987a3820" candidate_uuid: "b7fa9a15bb5c473c8c716a68274da658" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1cc410ce164b7a9bacd3e74851a975"
I20260811 07:06:24.793262 16481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1882d5ae065148cf828420d8987a3820" candidate_uuid: "b7fa9a15bb5c473c8c716a68274da658" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93c2d47f822a498bad23e95f8d463f83"
I20260811 07:06:24.793543 16630 raft_consensus.cc:3037] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:24.793543 16481 raft_consensus.cc:3037] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:24.796988 16630 raft_consensus.cc:2454] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7fa9a15bb5c473c8c716a68274da658 in term 1.
I20260811 07:06:24.796988 16481 raft_consensus.cc:2454] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7fa9a15bb5c473c8c716a68274da658 in term 1.
I20260811 07:06:24.797578 16712 leader_election.cc:302] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5d1cc410ce164b7a9bacd3e74851a975, 93c2d47f822a498bad23e95f8d463f83, b7fa9a15bb5c473c8c716a68274da658; no voters:
I20260811 07:06:24.798019 16877 raft_consensus.cc:2781] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:06:24.798573 16877 raft_consensus.cc:686] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 1 LEADER]: Becoming Leader. State: Replica: b7fa9a15bb5c473c8c716a68274da658, State: Running, Role: LEADER
I20260811 07:06:24.799090 16877 consensus_queue.cc:237] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } }
W20260811 07:06:24.800604 16686 tablet.cc:2369] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:06:24.805348 16315 catalog_manager.cc:5495] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "b7fa9a15bb5c473c8c716a68274da658" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } health_report { overall_health: UNKNOWN } } }
I20260811 07:06:24.827962 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.822128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34408 (local address 127.30.73.67:41755)
0811 07:06:24.822363 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.822371 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.822485 (+ 114us) server_negotiation.cc:407] Connection header received
0811 07:06:24.822773 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.822777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.822866 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.823037 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:06:24.823438 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.824188 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.825637 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.826116 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.826261 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.826803 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:06:24.827350 (+ 547us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:06:24.827528 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.827584 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.827669 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:06:24.837044 16630 raft_consensus.cc:1261] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [term 1 FOLLOWER]: Refusing update from remote peer b7fa9a15bb5c473c8c716a68274da658: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:06:24.837067 16481 raft_consensus.cc:1261] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Refusing update from remote peer b7fa9a15bb5c473c8c716a68274da658: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:06:24.838239 16883 consensus_queue.cc:1035] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:06:24.838619 16877 consensus_queue.cc:1035] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:06:24.854523 16888 mvcc.cc:205] Tried to move back new op lower bound from 7317225409881436160 to 7317225409741881344. Current Snapshot: MvccSnapshot[applied={T|T < 7317225409881436160}]
I20260811 07:06:24.865404 16316 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:06:24.865754 16316 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:06:24.870232 16316 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Sending DeleteTablet for 3 replicas of tablet 1882d5ae065148cf828420d8987a3820
I20260811 07:06:24.871883 16458 tablet_service.cc:1514] Processing DeleteTablet for tablet 1882d5ae065148cf828420d8987a3820 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:06:24 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:53448
I20260811 07:06:24.871948 16770 tablet_service.cc:1514] Processing DeleteTablet for tablet 1882d5ae065148cf828420d8987a3820 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:06:24 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:34392
I20260811 07:06:24.872174 16607 tablet_service.cc:1514] Processing DeleteTablet for tablet 1882d5ae065148cf828420d8987a3820 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:06:24 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:39026
I20260811 07:06:24.873530 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 16386
I20260811 07:06:24.902112 16899 tablet_replica.cc:330] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: stopping tablet replica
I20260811 07:06:24.902359 16897 tablet_replica.cc:330] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: stopping tablet replica
I20260811 07:06:24.902686 16899 raft_consensus.cc:2229] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:06:24.902819 16897 raft_consensus.cc:2229] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:06:24.903242 16899 raft_consensus.cc:2258] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:06:24.903564 16897 raft_consensus.cc:2258] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:06:24.904387 16896 tablet_replica.cc:330] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: stopping tablet replica
I20260811 07:06:24.904834 16896 raft_consensus.cc:2229] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:06:24.905329 16896 raft_consensus.cc:2258] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:06:24.906980 16899 ts_tablet_manager.cc:1905] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:06:24.906986 16897 ts_tablet_manager.cc:1905] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:06:24.907379 16896 ts_tablet_manager.cc:1905] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:06:24.914685 16896 ts_tablet_manager.cc:1918] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:06:24.914877 16896 log.cc:1196] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/1882d5ae065148cf828420d8987a3820
I20260811 07:06:24.915038 16897 ts_tablet_manager.cc:1918] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:06:24.915324 16897 log.cc:1196] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/1882d5ae065148cf828420d8987a3820
I20260811 07:06:24.915485 16896 ts_tablet_manager.cc:1939] T 1882d5ae065148cf828420d8987a3820 P 93c2d47f822a498bad23e95f8d463f83: Deleting consensus metadata
I20260811 07:06:24.916031 16897 ts_tablet_manager.cc:1939] T 1882d5ae065148cf828420d8987a3820 P b7fa9a15bb5c473c8c716a68274da658: Deleting consensus metadata
I20260811 07:06:24.917928 16299 catalog_manager.cc:4841] TS b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755): tablet 1882d5ae065148cf828420d8987a3820 (table test-table [id=0d94d181e4224948ad91fe3416dc8448]) successfully deleted
I20260811 07:06:24.917900 16298 catalog_manager.cc:4841] TS 93c2d47f822a498bad23e95f8d463f83 (127.30.73.65:35709): tablet 1882d5ae065148cf828420d8987a3820 (table test-table [id=0d94d181e4224948ad91fe3416dc8448]) successfully deleted
I20260811 07:06:24.918923 16899 ts_tablet_manager.cc:1918] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:06:24.919116 16899 log.cc:1196] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/1882d5ae065148cf828420d8987a3820
I20260811 07:06:24.919581 16899 ts_tablet_manager.cc:1939] T 1882d5ae065148cf828420d8987a3820 P 5d1cc410ce164b7a9bacd3e74851a975: Deleting consensus metadata
I20260811 07:06:24.921106 16299 catalog_manager.cc:4841] TS 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769): tablet 1882d5ae065148cf828420d8987a3820 (table test-table [id=0d94d181e4224948ad91fe3416dc8448]) successfully deleted
Aug 11 07:06:24 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:06:24.928750 16865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:24.874585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.30.73.65:35709)
0811 07:06:24.874843 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:24.874853 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:24.897041 (+ 22188us) server_negotiation.cc:407] Connection header received
0811 07:06:24.897754 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:24.897765 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:24.897951 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:24.898054 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:24.903737 (+ 5683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.904727 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.912109 (+ 7382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:24.912976 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:24.913096 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:24.922740 (+ 9644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:24.922754 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:24.922768 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:24.922808 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:24.925699 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:24.926523 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:24.926530 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:24.926533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:24.926665 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:24.927092 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:24.927096 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:24.927098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:24.927478 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:24.927808 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:24.928150 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 07:06:24.928382 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:06:24.929523 16528 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:25.022699 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 16386
I20260811 07:06:25.045800 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 16541
Aug 11 07:06:25 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:06:25.064416 16868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:25.047094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39042 (local address 127.30.73.66:36769)
0811 07:06:25.047320 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:25.047326 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:25.047344 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:06:25.047407 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:25.047410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:25.047529 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:25.047656 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:25.049162 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:25.050071 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:25.051865 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:25.052325 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:25.052474 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:25.057322 (+ 4848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:25.057335 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:25.057351 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:25.057387 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:25.060845 (+ 3458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:25.061675 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:25.061692 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:25.061694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:25.061882 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:25.062408 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:25.062414 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:25.062418 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:25.062866 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:25.063175 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:25.063773 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 07:06:25.064020 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:06:25.065263 16680 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:25.163729 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 16541
I20260811 07:06:25.185161 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 16692
Aug 11 07:06:25 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:06:25.205031 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:25.186042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34420 (local address 127.30.73.67:41755)
0811 07:06:25.186232 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:25.186236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:25.186255 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:06:25.186459 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:25.186463 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:25.186558 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:25.186641 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:25.188619 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:25.189465 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:25.191663 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:25.192164 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:25.192273 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:25.198200 (+ 5927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:25.198218 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:25.198237 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:25.198282 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:25.201719 (+ 3437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:25.202660 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:25.202668 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:25.202670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:25.202863 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:25.203302 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:25.203306 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:25.203308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:25.203716 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:25.204082 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:25.204390 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 07:06:25.204639 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:06:25.205737 16841 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:25.337247 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 16692
I20260811 07:06:25.364657 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 16274
I20260811 07:06:25.366035 16350 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:25.480409 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 16274
I20260811 07:06:45.509063 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36239
--webserver_interface=127.30.73.126
--webserver_port=33167
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:36239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:06:45.937274 16908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:45.937716 16908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:45.937913 16908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:45.945621 16908 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:06:45.945801 16908 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:06:45.945923 16908 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:06:45.946014 16908 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:06:45.946126 16908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:45.946252 16908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:45.946342 16908 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:06:45.946424 16908 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:06:45.957333 16908 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:36239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=33167
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:45.958961 16908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:45.960556 16908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:45.991428 16916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:45.991761 16918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:45.991989 16915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:45.992923 16908 server_base.cc:1034] running on GCE node
I20260811 07:06:45.994099 16908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:45.995966 16908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:45.997289 16908 hybrid_clock.cc:648] HybridClock initialized: now 1786432005997207 us; error 49 us; skew 500 ppm
I20260811 07:06:45.997776 16908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:46 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432006, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:46.009423 16908 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:06:46.011885 16908 webserver.cc:460] Webserver started at http://127.30.73.126:33167/ using document root <none> and password file <none>
I20260811 07:06:46.012862 16908 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:46.013043 16908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:46.021792 16908 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 07:06:46.027884 16926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:46.030532 16908 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.005s sys 0.001s
I20260811 07:06:46.030982 16908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "bc42e23ce67641dda8a338e91fea665f"
format_stamp: "Formatted at 2026-08-11 07:06:22 on dist-test-slave-69rg"
server_key: "481608a6c168b0fb68c66282f440ad19"
server_key_iv: "cf74e3a820069f7b53f93a1611fcf174"
server_key_version: "encryptionkey@0"
I20260811 07:06:46.032667 16908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:46.054766 16908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:46.062320 16908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:46.062796 16908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:46.087203 16908 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:36239
I20260811 07:06:46.087206 16981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:36239 every 8 connection(s)
I20260811 07:06:46.089113 16908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:06:46.093097 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 16908
I20260811 07:06:46.094281 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:35709
--local_ip_for_outbound_sockets=127.30.73.65
--tserver_master_addrs=127.30.73.126:36239
--webserver_port=44461
--webserver_interface=127.30.73.65
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:06:46.100265 16982 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:06:46.106178 16982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Bootstrap starting.
I20260811 07:06:46.130785 16982 log.cc:824] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:46.150377 16982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:06:46.151156 16982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Bootstrap complete.
I20260811 07:06:46.165683 16982 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:06:46.167344 16982 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc42e23ce67641dda8a338e91fea665f, State: Initialized, Role: FOLLOWER
I20260811 07:06:46.168192 16982 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:06:46.168839 16982 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:06:46.169224 16982 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:06:46.169484 16982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:06:46.177166 16982 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:06:46.178203 16982 leader_election.cc:302] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc42e23ce67641dda8a338e91fea665f; no voters:
I20260811 07:06:46.179100 16982 leader_election.cc:288] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:06:46.179296 16987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:06:46.180940 16987 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 2 LEADER]: Becoming Leader. State: Replica: bc42e23ce67641dda8a338e91fea665f, State: Running, Role: LEADER
I20260811 07:06:46.181871 16982 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:06:46.181951 16987 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:06:46.186600 16989 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bc42e23ce67641dda8a338e91fea665f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } } }
I20260811 07:06:46.187126 16989 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: This master's current role is: LEADER
I20260811 07:06:46.187863 16990 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc42e23ce67641dda8a338e91fea665f. Latest consensus state: current_term: 2 leader_uuid: "bc42e23ce67641dda8a338e91fea665f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } } }
I20260811 07:06:46.188259 16990 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: This master's current role is: LEADER
I20260811 07:06:46.195801 16996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:06:46.208374 16996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:06:46.210497 16996 catalog_manager.cc:1259] Loaded cluster ID: e3c7c6c2eea54130ad8fbe546dfc9ba3
I20260811 07:06:46.210714 16996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:06:46.216555 16996 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:06:46.218704 16996 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Loaded TSK: 0
I20260811 07:06:46.281349 16996 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Generated new TSK 1
I20260811 07:06:46.281839 16996 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:06:46.531070 16984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:46.531373 16984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:46.531524 16984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:46.539352 16984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:46.539476 16984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:46.539656 16984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:06:46.550242 16984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:35709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=44461
--tserver_master_addrs=127.30.73.126:36239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:46.551632 16984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:46.552997 16984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:46.568203 17015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:46.569114 17016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:46.569402 17018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:46.570214 16984 server_base.cc:1034] running on GCE node
I20260811 07:06:46.571065 16984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:46.572233 16984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:46.573493 16984 hybrid_clock.cc:648] HybridClock initialized: now 1786432006573424 us; error 58 us; skew 500 ppm
I20260811 07:06:46.573920 16984 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:46 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432006, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:46.577242 16984 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:06:46.578908 16984 webserver.cc:460] Webserver started at http://127.30.73.65:44461/ using document root <none> and password file <none>
I20260811 07:06:46.579811 16984 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:46.580008 16984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:46.586194 16984 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 07:06:46.589214 17027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:46.590797 16984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:06:46.591001 16984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "93c2d47f822a498bad23e95f8d463f83"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "075911c749d6373ede29fd9510e0e4fe"
server_key_iv: "a3188f9e7995d1b1f09d6b63daf8d48c"
server_key_version: "encryptionkey@0"
I20260811 07:06:46.592068 16984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:46.610116 16984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:46.615121 16984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:46.615453 16984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:46.616636 16984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:46.618337 16984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:46.618464 16984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:46.618607 16984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:46.618703 16984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:46.655078 16984 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:35709
I20260811 07:06:46.655126 17155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:35709 every 8 connection(s)
I20260811 07:06:46.656513 16984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:06:46.663331 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 16984
I20260811 07:06:46.664196 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:36769
--local_ip_for_outbound_sockets=127.30.73.66
--tserver_master_addrs=127.30.73.126:36239
--webserver_port=35689
--webserver_interface=127.30.73.66
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:06:46 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432006, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:46.683218 17158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:46.659507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:39817 (local address 127.30.73.126:36239)
0811 07:06:46.660057 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:46.660069 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:46.660824 (+ 755us) server_negotiation.cc:407] Connection header received
0811 07:06:46.663410 (+ 2586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:46.663431 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:46.663930 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:46.664392 (+ 462us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:46.666200 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:46.668282 (+ 2082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:46.669906 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:46.670994 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:46.671212 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:46.674745 (+ 3533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:46.674759 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:46.674781 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:46.674841 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:46.678353 (+ 3512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:46.679346 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:46.679353 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:46.679358 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:46.679508 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:46.680009 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:46.680013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:46.680015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:46.680485 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:46.680630 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:46.681643 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0811 07:06:46.682053 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":234,"threads_started":1}
I20260811 07:06:46.683425 17160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:46.659762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:39817)
0811 07:06:46.660635 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:46.660682 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:46.662748 (+ 2066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:46.664726 (+ 1978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:46.664735 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:46.665269 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:06:46.665946 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:46.665966 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:46.668476 (+ 2510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:46.668480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:46.669733 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:46.669746 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:46.671223 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:46.671229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:46.671413 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:46.672135 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:06:46.672160 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:06:46.674417 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:06:46.678514 (+ 4097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:46.678527 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:46.678546 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:46.679200 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:46.679623 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:46.679630 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:46.679636 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:46.679895 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:46.680633 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:06:46.680643 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:06:46.681079 (+ 436us) client_negotiation.cc:769] Sending connection context
0811 07:06:46.681394 (+ 315us) client_negotiation.cc:240] Negotiation successful
0811 07:06:46.682062 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":371,"threads_started":1}
I20260811 07:06:46.686609 17156 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36239
I20260811 07:06:46.686952 17156 heartbeater.cc:464] Registering TS with master...
I20260811 07:06:46.687892 17156 heartbeater.cc:511] Master 127.30.73.126:36239 requested a full tablet report, sending...
I20260811 07:06:46.690268 16944 ts_manager.cc:194] Registered new tserver with Master: 93c2d47f822a498bad23e95f8d463f83 (127.30.73.65:35709)
I20260811 07:06:46.691949 16944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:39817
W20260811 07:06:47.016471 17161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:47.016794 17161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:47.016942 17161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:47.024646 17161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:47.024783 17161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:47.024971 17161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:06:47.035043 17161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:36769
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=35689
--tserver_master_addrs=127.30.73.126:36239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:47.036377 17161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:47.037684 17161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:47.051798 17168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:47.051976 17169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:47.051934 17172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:47.052995 17161 server_base.cc:1034] running on GCE node
I20260811 07:06:47.053683 17161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:47.054728 17161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:47.056001 17161 hybrid_clock.cc:648] HybridClock initialized: now 1786432007055922 us; error 67 us; skew 500 ppm
I20260811 07:06:47.056366 17161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:47 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432007, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:47.059934 17161 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:06:47.061436 17161 webserver.cc:460] Webserver started at http://127.30.73.66:35689/ using document root <none> and password file <none>
I20260811 07:06:47.062212 17161 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:47.062379 17161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:47.068090 17161 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:06:47.071313 17179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:47.072745 17161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:06:47.072950 17161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "5d1cc410ce164b7a9bacd3e74851a975"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "8463432c7977b0cdd65b576db1993240"
server_key_iv: "4801d5e8ec816b280bdcc55c174453bc"
server_key_version: "encryptionkey@0"
I20260811 07:06:47.074079 17161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:47.112528 17161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:47.117026 17161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:47.117338 17161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:47.118592 17161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:47.119968 17161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:47.120114 17161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:47.120246 17161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:47.120337 17161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:47.157027 17161 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:36769
I20260811 07:06:47.157126 17312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:36769 every 8 connection(s)
I20260811 07:06:47.158975 17161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:06:47.160874 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 17161
I20260811 07:06:47.161775 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:41755
--local_ip_for_outbound_sockets=127.30.73.67
--tserver_master_addrs=127.30.73.126:36239
--webserver_port=37613
--webserver_interface=127.30.73.67
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:06:47 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432007, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:47.185510 17158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.162257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:43993 (local address 127.30.73.126:36239)
0811 07:06:47.162460 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.162465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.163585 (+ 1120us) server_negotiation.cc:407] Connection header received
0811 07:06:47.165688 (+ 2103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.165695 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.165800 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.165892 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:47.168032 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.169282 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.171876 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.172552 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.172682 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.177489 (+ 4807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:47.177499 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:47.177508 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:47.177558 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:47.181505 (+ 3947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.182465 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.182474 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.182481 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.182714 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.183295 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.183302 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.183309 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.183747 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:47.183908 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.184713 (+ 805us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.185019 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:06:47.186661 17315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.162542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:43993)
0811 07:06:47.163415 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:47.163455 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:47.165385 (+ 1930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:47.166391 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:47.166403 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:47.167090 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:06:47.167833 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.167858 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.169519 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.169527 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.171700 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.171720 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.172809 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.172819 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.173160 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.173991 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:06:47.174027 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:06:47.177159 (+ 3132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:06:47.181665 (+ 4506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:47.181671 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:47.181684 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:47.182317 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:47.182886 (+ 569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:47.182890 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:47.182892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:47.183137 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:47.183907 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:06:47.183914 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:06:47.184301 (+ 387us) client_negotiation.cc:769] Sending connection context
0811 07:06:47.184551 (+ 250us) client_negotiation.cc:240] Negotiation successful
0811 07:06:47.184986 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":352,"threads_started":1}
I20260811 07:06:47.188493 17313 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36239
I20260811 07:06:47.188871 17313 heartbeater.cc:464] Registering TS with master...
I20260811 07:06:47.189898 17313 heartbeater.cc:511] Master 127.30.73.126:36239 requested a full tablet report, sending...
I20260811 07:06:47.191821 16944 ts_manager.cc:194] Registered new tserver with Master: 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769)
I20260811 07:06:47.193423 16944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:43993
W20260811 07:06:47.530786 17318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:06:47.531086 17318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:06:47.531196 17318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:06:47.538895 17318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:06:47.539021 17318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:06:47.539228 17318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:06:47.549950 17318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:41755
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=37613
--tserver_master_addrs=127.30.73.126:36239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:06:47.551339 17318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:06:47.552738 17318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:06:47.566470 17323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:47.566450 17324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:06:47.566604 17326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:06:47.567799 17318 server_base.cc:1034] running on GCE node
I20260811 07:06:47.568492 17318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:06:47.569505 17318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:06:47.570744 17318 hybrid_clock.cc:648] HybridClock initialized: now 1786432007570656 us; error 79 us; skew 500 ppm
I20260811 07:06:47.571079 17318 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:06:47 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432007, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:06:47.574425 17318 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:06:47.576009 17318 webserver.cc:460] Webserver started at http://127.30.73.67:37613/ using document root <none> and password file <none>
I20260811 07:06:47.576709 17318 fs_manager.cc:359] Metadata directory not provided
I20260811 07:06:47.576871 17318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:06:47.582716 17318 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:06:47.585510 17333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:47.586952 17318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:06:47.587139 17318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "b7fa9a15bb5c473c8c716a68274da658"
format_stamp: "Formatted at 2026-08-11 07:06:24 on dist-test-slave-69rg"
server_key: "fa3d609fdabe4d9d3c0ae289ed3abc3f"
server_key_iv: "008a7b4f0a530b2287946c2c1535367c"
server_key_version: "encryptionkey@0"
I20260811 07:06:47.588156 17318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:06:47.607829 17318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:06:47.612709 17318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:06:47.613030 17318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:06:47.614194 17318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:06:47.615757 17318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:06:47.615909 17318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:47.616041 17318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:06:47.616140 17318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:06:47.653900 17318 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:41755
I20260811 07:06:47.653990 17461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:41755 every 8 connection(s)
I20260811 07:06:47.655763 17318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:06:47.660151 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 17318
Aug 11 07:06:47 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432007, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:06:47.679167 17465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.661279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50612 (local address 127.30.73.126:36239)
0811 07:06:47.661781 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.661787 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.662396 (+ 609us) server_negotiation.cc:407] Connection header received
0811 07:06:47.662577 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.662584 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.662684 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.662817 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:47.665180 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.666497 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.668098 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.668784 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.668885 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.672113 (+ 3228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:47.672120 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:47.672125 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:47.672167 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:47.675681 (+ 3514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.676547 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.676553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.676557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.676731 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.677185 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.677188 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.677190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.677615 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:47.677967 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.678404 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.678674 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":390,"thread_start_us":255,"threads_started":1}
I20260811 07:06:47.680449 17158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.658801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:38109 (local address 127.30.73.126:36239)
0811 07:06:47.658979 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.658984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.660466 (+ 1482us) server_negotiation.cc:407] Connection header received
0811 07:06:47.663292 (+ 2826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.663296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.663357 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.663448 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:47.665535 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.666682 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.668441 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.669048 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.669182 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.673034 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:47.673040 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:47.673044 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:47.673094 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:47.676109 (+ 3015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.677104 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.677111 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.677114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.677274 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.677776 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.677781 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.677783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.678265 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:47.678403 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.679812 (+ 1409us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.680022 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":59,"spinlock_wait_cycles":17280}
I20260811 07:06:47.681126 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.659292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:38109)
0811 07:06:47.660274 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:47.660343 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:47.662969 (+ 2626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:47.663769 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:47.663784 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:47.664577 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:06:47.665361 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.665381 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.666867 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.666872 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.668284 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.668298 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.669271 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.669276 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.669480 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.670091 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:06:47.670113 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:06:47.672830 (+ 2717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:06:47.676300 (+ 3470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:47.676308 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:47.676322 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:47.676987 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:47.677373 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:06:47.677378 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:06:47.677381 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:06:47.677648 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:06:47.678461 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:06:47.678469 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:06:47.679001 (+ 532us) client_negotiation.cc:769] Sending connection context
0811 07:06:47.679364 (+ 363us) client_negotiation.cc:240] Negotiation successful
0811 07:06:47.679802 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":395,"threads_started":1}
I20260811 07:06:47.682785 17462 heartbeater.cc:347] Connected to a master server at 127.30.73.126:36239
I20260811 07:06:47.683104 17462 heartbeater.cc:464] Registering TS with master...
I20260811 07:06:47.683899 17462 heartbeater.cc:511] Master 127.30.73.126:36239 requested a full tablet report, sending...
I20260811 07:06:47.685322 16944 ts_manager.cc:194] Registered new tserver with Master: b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755)
I20260811 07:06:47.686196 16944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:38109
I20260811 07:06:47.694594 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:06:47.696008 17156 heartbeater.cc:503] Master 127.30.73.126:36239 was elected leader, sending a full tablet report...
I20260811 07:06:47.702137 17158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.695641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50628 (local address 127.30.73.126:36239)
0811 07:06:47.695973 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.695982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.696698 (+ 716us) server_negotiation.cc:407] Connection header received
0811 07:06:47.696816 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.696821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.697029 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.697203 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:06:47.697763 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.698661 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.700181 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.700586 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.700731 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.701243 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:06:47.701446 (+ 203us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 07:06:47.701854 (+ 408us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50628: token expired
Metrics: {"server-negotiator.queue_time_us":98}
W20260811 07:06:47.702291 17158 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50628: token expired
W20260811 07:06:47.702780 16853 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.30.73.126:36239)
I20260811 07:06:47.716569 17158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.703372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50642 (local address 127.30.73.126:36239)
0811 07:06:47.703512 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.703516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.703531 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:06:47.703683 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.703687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.703749 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.703833 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:47.705325 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.706257 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.707613 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.707999 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.708151 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.711160 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:47.711165 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:47.711169 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:47.711205 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:47.713992 (+ 2787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.714731 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.714736 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.714738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.714870 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.715240 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.715243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.715246 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.715566 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:47.715781 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.716098 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.716322 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 07:06:47.720418 16944 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:06:47.727918 16944 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:06:47.763875 17474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.740270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:36769 (local address 127.0.0.1:49840)
0811 07:06:47.747278 (+ 7008us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:47.747336 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:47.747581 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:47.753272 (+ 5691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:47.753284 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:47.753333 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:47.753925 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.753943 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.756304 (+ 2361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.756314 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.759231 (+ 2917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.759246 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.762605 (+ 3359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.762613 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.762857 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.762918 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 07:06:47.763240 (+ 322us) client_negotiation.cc:240] Negotiation successful
0811 07:06:47.763462 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6644,"thread_start_us":6457,"threads_started":1}
I20260811 07:06:47.764902 17476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.740891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49840 (local address 127.30.73.66:36769)
0811 07:06:47.752412 (+ 11521us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.752427 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.752474 (+ 47us) server_negotiation.cc:407] Connection header received
0811 07:06:47.752624 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.752637 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.752971 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.753227 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:47.754230 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.756135 (+ 1905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.759441 (+ 3306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.762327 (+ 2886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.762480 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.763107 (+ 627us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.764340 (+ 1233us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.764539 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11279,"thread_start_us":11104,"threads_started":1}
I20260811 07:06:47.768918 17473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.740286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:42422)
0811 07:06:47.755889 (+ 15603us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:47.755909 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:47.756024 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:47.761617 (+ 5593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:47.761622 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:47.761649 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:47.762111 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.762125 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.764101 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.764106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.766319 (+ 2213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.766331 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.768077 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.768083 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.768284 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.768318 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:06:47.768425 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 07:06:47.768558 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15470,"thread_start_us":15343,"threads_started":1}
I20260811 07:06:47.768980 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.740554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42422 (local address 127.30.73.65:35709)
0811 07:06:47.761167 (+ 20613us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.761174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.761196 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:06:47.761268 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.761273 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.761428 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.761625 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:47.762360 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.763923 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.766477 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.767842 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.768011 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.768240 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.768485 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.768653 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20432,"thread_start_us":20269,"threads_started":1}
I20260811 07:06:47.768743 17234 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 (DEFAULT_TABLE table=test-table [id=3717ff7e72384bf88b3806874c25f2f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:06:47.770289 17234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:47.770967 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.753185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41755 (local address 127.0.0.1:59968)
0811 07:06:47.758485 (+ 5300us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:47.758515 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:47.758678 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:47.760269 (+ 1591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:47.760277 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:47.760313 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:47.760639 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.760651 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.763490 (+ 2839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.763497 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.765233 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.765262 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.770071 (+ 4809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.770077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.770258 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.770284 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 07:06:47.770420 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 07:06:47.770572 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5101,"thread_start_us":4901,"threads_started":1}
I20260811 07:06:47.771093 17477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.748362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59968 (local address 127.30.73.67:41755)
0811 07:06:47.759424 (+ 11062us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.759437 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.759482 (+ 45us) server_negotiation.cc:407] Connection header received
0811 07:06:47.759621 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.759633 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.759991 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.760273 (+ 282us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:47.760862 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.763348 (+ 2486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.765422 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.766902 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.767134 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.767369 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.770491 (+ 3122us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.770694 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10780,"thread_start_us":10874,"threads_started":1}
I20260811 07:06:47.775213 17386 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 (DEFAULT_TABLE table=test-table [id=3717ff7e72384bf88b3806874c25f2f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:06:47.775218 17082 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 (DEFAULT_TABLE table=test-table [id=3717ff7e72384bf88b3806874c25f2f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:06:47.776898 17386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:47.776926 17082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:06:47.787025 17479 tablet_bootstrap.cc:492] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: Bootstrap starting.
I20260811 07:06:47.791383 17479 tablet_bootstrap.cc:654] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:47.793228 17480 tablet_bootstrap.cc:492] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Bootstrap starting.
I20260811 07:06:47.793366 17479 log.cc:824] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:47.794736 17481 tablet_bootstrap.cc:492] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: Bootstrap starting.
I20260811 07:06:47.797181 17480 tablet_bootstrap.cc:654] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:47.798331 17480 log.cc:824] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:47.798827 17479 tablet_bootstrap.cc:492] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: No bootstrap required, opened a new log
I20260811 07:06:47.798842 17481 tablet_bootstrap.cc:654] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: Neither blocks nor log segments found. Creating new log.
I20260811 07:06:47.799249 17479 ts_tablet_manager.cc:1397] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260811 07:06:47.800249 17481 log.cc:824] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: Log is configured to *not* fsync() on all Append() calls
I20260811 07:06:47.802325 17480 tablet_bootstrap.cc:492] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: No bootstrap required, opened a new log
I20260811 07:06:47.802616 17480 ts_tablet_manager.cc:1397] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 07:06:47.803700 17481 tablet_bootstrap.cc:492] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: No bootstrap required, opened a new log
I20260811 07:06:47.803999 17481 ts_tablet_manager.cc:1397] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 07:06:47.809626 17480 raft_consensus.cc:348] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:06:47.810081 17480 raft_consensus.cc:374] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:47.810187 17480 raft_consensus.cc:729] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93c2d47f822a498bad23e95f8d463f83, State: Initialized, Role: FOLLOWER
I20260811 07:06:47.810822 17480 consensus_queue.cc:260] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:06:47.811365 17479 raft_consensus.cc:348] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:06:47.811859 17479 raft_consensus.cc:374] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:47.811991 17479 raft_consensus.cc:729] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1cc410ce164b7a9bacd3e74851a975, State: Initialized, Role: FOLLOWER
I20260811 07:06:47.812776 17479 consensus_queue.cc:260] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:06:47.814262 17480 ts_tablet_manager.cc:1428] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260811 07:06:47.815351 17313 heartbeater.cc:503] Master 127.30.73.126:36239 was elected leader, sending a full tablet report...
I20260811 07:06:47.816385 17481 raft_consensus.cc:348] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:06:47.816905 17481 raft_consensus.cc:374] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:06:47.817060 17481 raft_consensus.cc:729] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7fa9a15bb5c473c8c716a68274da658, State: Initialized, Role: FOLLOWER
I20260811 07:06:47.817740 17479 ts_tablet_manager.cc:1428] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: Time spent starting tablet: real 0.018s user 0.014s sys 0.003s
I20260811 07:06:47.817785 17481 consensus_queue.cc:260] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:06:47.819212 17462 heartbeater.cc:503] Master 127.30.73.126:36239 was elected leader, sending a full tablet report...
I20260811 07:06:47.819921 17481 ts_tablet_manager.cc:1428] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260811 07:06:47.860195 17486 raft_consensus.cc:482] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:06:47.860595 17486 raft_consensus.cc:504] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:06:47.862916 17486 leader_election.cc:288] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93c2d47f822a498bad23e95f8d463f83 (127.30.73.65:35709), b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755)
I20260811 07:06:47.872679 17477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.863437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:59599 (local address 127.30.73.67:41755)
0811 07:06:47.863658 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.863665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.864524 (+ 859us) server_negotiation.cc:407] Connection header received
0811 07:06:47.864733 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.864738 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.864810 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.864910 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:47.865776 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.867020 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.870274 (+ 3254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.871539 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.871703 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.871785 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.872280 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.872410 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:06:47.872680 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.863540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:54427 (local address 127.30.73.65:35709)
0811 07:06:47.863742 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.863750 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.864528 (+ 778us) server_negotiation.cc:407] Connection header received
0811 07:06:47.864711 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.864716 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.864801 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.864910 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:06:47.865770 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.867055 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.870244 (+ 3189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.871521 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.871703 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.871804 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.872273 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.872410 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:06:47.873030 17488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.863295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41755 (local address 127.30.73.66:59599)
0811 07:06:47.864361 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:47.864383 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:47.864595 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:47.864941 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:47.864946 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:47.864980 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:47.865594 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.865607 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.867185 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.867190 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.870040 (+ 2850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.870050 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.871819 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.871826 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.872048 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.872135 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 07:06:47.872230 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:06:47.872458 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"mutex_wait_us":312,"spinlock_wait_cycles":37504,"thread_start_us":659,"threads_started":1}
I20260811 07:06:47.873044 17489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.863559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.30.73.66:54427)
0811 07:06:47.864410 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:47.864434 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:06:47.864550 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:06:47.864941 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:06:47.864946 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:06:47.864987 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:06:47.865491 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.865511 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.867186 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.867190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.870012 (+ 2822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:06:47.870031 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.871819 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.871826 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:06:47.872048 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.872129 (+ 81us) client_negotiation.cc:769] Sending connection context
0811 07:06:47.872230 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:06:47.872458 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":287,"spinlock_wait_cycles":3328,"thread_start_us":513,"threads_started":1}
I20260811 07:06:47.874235 17414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1ff8cb571f4cd4bb4f6dbc7f4df1b4" candidate_uuid: "5d1cc410ce164b7a9bacd3e74851a975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7fa9a15bb5c473c8c716a68274da658" is_pre_election: true
I20260811 07:06:47.874262 17105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1ff8cb571f4cd4bb4f6dbc7f4df1b4" candidate_uuid: "5d1cc410ce164b7a9bacd3e74851a975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93c2d47f822a498bad23e95f8d463f83" is_pre_election: true
I20260811 07:06:47.874782 17414 raft_consensus.cc:2454] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1cc410ce164b7a9bacd3e74851a975 in term 0.
I20260811 07:06:47.874794 17105 raft_consensus.cc:2454] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1cc410ce164b7a9bacd3e74851a975 in term 0.
I20260811 07:06:47.875520 17183 leader_election.cc:302] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5d1cc410ce164b7a9bacd3e74851a975, 93c2d47f822a498bad23e95f8d463f83, b7fa9a15bb5c473c8c716a68274da658; no voters:
I20260811 07:06:47.875975 17486 raft_consensus.cc:2781] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:06:47.876138 17486 raft_consensus.cc:482] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:06:47.876248 17486 raft_consensus.cc:3037] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:47.879066 17486 raft_consensus.cc:504] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:06:47.879737 17486 leader_election.cc:288] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [CANDIDATE]: Term 1 election: Requested vote from peers 93c2d47f822a498bad23e95f8d463f83 (127.30.73.65:35709), b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755)
I20260811 07:06:47.880398 17105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1ff8cb571f4cd4bb4f6dbc7f4df1b4" candidate_uuid: "5d1cc410ce164b7a9bacd3e74851a975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93c2d47f822a498bad23e95f8d463f83"
I20260811 07:06:47.880389 17414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1ff8cb571f4cd4bb4f6dbc7f4df1b4" candidate_uuid: "5d1cc410ce164b7a9bacd3e74851a975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7fa9a15bb5c473c8c716a68274da658"
I20260811 07:06:47.880667 17105 raft_consensus.cc:3037] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:47.880671 17414 raft_consensus.cc:3037] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:06:47.884526 17105 raft_consensus.cc:2454] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1cc410ce164b7a9bacd3e74851a975 in term 1.
I20260811 07:06:47.884526 17414 raft_consensus.cc:2454] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1cc410ce164b7a9bacd3e74851a975 in term 1.
I20260811 07:06:47.885114 17182 leader_election.cc:302] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5d1cc410ce164b7a9bacd3e74851a975, 93c2d47f822a498bad23e95f8d463f83, b7fa9a15bb5c473c8c716a68274da658; no voters:
I20260811 07:06:47.885515 17486 raft_consensus.cc:2781] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:06:47.886111 17486 raft_consensus.cc:686] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 1 LEADER]: Becoming Leader. State: Replica: 5d1cc410ce164b7a9bacd3e74851a975, State: Running, Role: LEADER
I20260811 07:06:47.886826 17486 consensus_queue.cc:237] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:06:47.891898 16944 catalog_manager.cc:5495] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66). New cstate: current_term: 1 leader_uuid: "5d1cc410ce164b7a9bacd3e74851a975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } health_report { overall_health: UNKNOWN } } }
W20260811 07:06:47.907671 17463 tablet.cc:2369] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:06:47.909116 17157 tablet.cc:2369] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:06:47.911031 17314 tablet.cc:2369] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:06:47.930032 17476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.924389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49856 (local address 127.30.73.66:36769)
0811 07:06:47.924635 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.924641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.924663 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:06:47.924913 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.924918 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.925007 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.925196 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:06:47.925574 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.926366 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.927882 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.928301 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.928431 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.928927 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:06:47.929419 (+ 492us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:06:47.929580 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.929642 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.929728 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:06:47.938417 17414 raft_consensus.cc:1261] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [term 1 FOLLOWER]: Refusing update from remote peer 5d1cc410ce164b7a9bacd3e74851a975: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:06:47.938443 17105 raft_consensus.cc:1261] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Refusing update from remote peer 5d1cc410ce164b7a9bacd3e74851a975: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:06:47.939476 17486 consensus_queue.cc:1035] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:06:47.939744 17490 consensus_queue.cc:1035] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:06:47.949868 17495 mvcc.cc:205] Tried to move back new op lower bound from 7317225504504950784 to 7317225504309161984. Current Snapshot: MvccSnapshot[applied={T|T < 7317225504504950784}]
I20260811 07:06:47.951215 17496 mvcc.cc:205] Tried to move back new op lower bound from 7317225504504950784 to 7317225504309161984. Current Snapshot: MvccSnapshot[applied={T|T < 7317225504504950784}]
I20260811 07:06:47.970191 16943 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:06:47.970504 16943 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:06:47.974386 16943 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Sending DeleteTablet for 3 replicas of tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
I20260811 07:06:47.975777 17082 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:06:47 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:42422
I20260811 07:06:47.975906 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 16984
I20260811 07:06:47.976125 17234 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:06:47 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:49840
I20260811 07:06:47.976724 17386 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:06:47 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:59968
I20260811 07:06:47.987447 17509 tablet_replica.cc:330] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: stopping tablet replica
I20260811 07:06:47.988195 17509 raft_consensus.cc:2229] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:06:47.989145 17509 raft_consensus.cc:2258] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:06:47.997202 17511 tablet_replica.cc:330] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: stopping tablet replica
I20260811 07:06:47.997888 17511 raft_consensus.cc:2229] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:06:47.998657 17511 raft_consensus.cc:2258] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:06:47.999627 17508 tablet_replica.cc:330] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: stopping tablet replica
I20260811 07:06:48.000073 17508 raft_consensus.cc:2229] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:06:48.000366 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:47.977869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42426 (local address 127.30.73.65:35709)
0811 07:06:47.978038 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:47.978044 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:47.978077 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:06:47.978136 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:47.978141 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:47.978249 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:47.978358 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:47.980468 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.981698 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.983719 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:47.984427 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:47.984554 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:47.990730 (+ 6176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:47.990747 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:47.990766 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:47.990809 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:47.995243 (+ 4434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.996373 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.996382 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.996386 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.996585 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:47.997062 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:47.997069 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:47.997072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:47.997553 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:47.997910 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:47.999550 (+ 1640us) server_negotiation.cc:299] Negotiation successful
0811 07:06:47.999813 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:06:48.000639 17508 raft_consensus.cc:2258] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:06:48.001413 17151 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:48.002480 17509 ts_tablet_manager.cc:1905] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:06:48.004451 17511 ts_tablet_manager.cc:1905] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:06:48.012384 17511 ts_tablet_manager.cc:1918] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:06:48.012853 17511 log.cc:1196] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
I20260811 07:06:48.013032 17509 ts_tablet_manager.cc:1918] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:06:48.013346 17509 log.cc:1196] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
I20260811 07:06:48.013661 17511 ts_tablet_manager.cc:1939] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P b7fa9a15bb5c473c8c716a68274da658: Deleting consensus metadata
I20260811 07:06:48.014153 17509 ts_tablet_manager.cc:1939] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 5d1cc410ce164b7a9bacd3e74851a975: Deleting consensus metadata
I20260811 07:06:48.016096 16930 catalog_manager.cc:4841] TS b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755): tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 (table test-table [id=3717ff7e72384bf88b3806874c25f2f6]) successfully deleted
I20260811 07:06:48.016464 16930 catalog_manager.cc:4841] TS 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769): tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 (table test-table [id=3717ff7e72384bf88b3806874c25f2f6]) successfully deleted
I20260811 07:06:48.149981 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 16984
W20260811 07:06:48.172045 16929 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.73.65:35709 (error 108)
I20260811 07:06:48.173592 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 17161
I20260811 07:06:48.174731 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.174038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:42432)
0811 07:06:48.174445 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:48.174557 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262}
W20260811 07:06:48.175182 16929 catalog_manager.cc:4584] TS 93c2d47f822a498bad23e95f8d463f83 (127.30.73.65:35709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4: Network error: Client connection negotiation failed: client connection to 127.30.73.65:35709: connect: Connection refused (error 111)
I20260811 07:06:48.198858 17476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.174918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49864 (local address 127.30.73.66:36769)
0811 07:06:48.175097 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:48.175103 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:48.175123 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:06:48.175190 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:48.175198 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:48.177419 (+ 2221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:48.177533 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:48.179895 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:48.181252 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:48.183409 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:48.183994 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:48.184146 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:48.192210 (+ 8064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:48.192260 (+ 50us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:48.192280 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:48.192343 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:48.195590 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:48.196432 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:48.196439 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:48.196441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:48.196596 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:48.196999 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:48.197003 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:48.197005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:48.197374 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:48.197747 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:48.198258 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 07:06:48.198483 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:06:48.199661 17306 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:48.228935 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.228400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:42442)
0811 07:06:48.228690 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:48.228787 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173}
I20260811 07:06:48.230028 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.229624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:42450)
0811 07:06:48.229786 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:48.229908 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 07:06:48.290716 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.290248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:42460)
0811 07:06:48.290459 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:48.290550 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 07:06:48.291882 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.291481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:42464)
0811 07:06:48.291637 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:48.291715 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 07:06:48.316340 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 17161
I20260811 07:06:48.345528 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 17318
I20260811 07:06:48.365604 17477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.346384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59970 (local address 127.30.73.67:41755)
0811 07:06:48.346619 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 07:06:48.346628 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:06:48.346728 (+ 100us) server_negotiation.cc:407] Connection header received
0811 07:06:48.347029 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:06:48.347038 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:06:48.347135 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:06:48.347279 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:06:48.348914 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:48.349891 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:48.352090 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:06:48.352895 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:06:48.353067 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:06:48.356804 (+ 3737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:06:48.356825 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:06:48.356848 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:06:48.356895 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:06:48.361604 (+ 4709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:48.362862 (+ 1258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:48.362874 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:48.362880 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:48.363090 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:06:48.363642 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:06:48.363651 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:06:48.363655 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:06:48.364221 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:06:48.364558 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0811 07:06:48.364962 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 07:06:48.365188 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:06:48.366550 17457 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:48.372823 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.372168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:42480)
0811 07:06:48.372409 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:48.372542 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 07:06:48.374279 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.373624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:42484)
0811 07:06:48.373983 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:48.374104 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222}
I20260811 07:06:48.464573 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 17318
I20260811 07:06:48.487874 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 16908
I20260811 07:06:48.489135 16976 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:06:48.605266 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:06:48.604706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:35709 (local address 127.0.0.1:42500)
0811 07:06:48.604912 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 07:06:48.605012 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 07:06:48.605551 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 16908
I20260811 07:07:08.634253 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36239
--webserver_interface=127.30.73.126
--webserver_port=33167
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:36239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:09.174916 17518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:09.175371 17518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:09.175483 17518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:09.184021 17518 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:07:09.184186 17518 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:07:09.184231 17518 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:07:09.184283 17518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:09.184346 17518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:09.184428 17518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:09.184477 17518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:09.184544 17518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:09.196858 17518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:36239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:36239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=33167
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:09.198844 17518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:09.200567 17518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:09.216570 17525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:09.216605 17526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:09.216642 17529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:09.217130 17518 server_base.cc:1034] running on GCE node
I20260811 07:07:09.218382 17518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:09.220270 17518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:09.221555 17518 hybrid_clock.cc:648] HybridClock initialized: now 1786432029221483 us; error 46 us; skew 500 ppm
I20260811 07:07:09.222044 17518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:09 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432029, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:09.226061 17518 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:07:09.227962 17518 webserver.cc:460] Webserver started at http://127.30.73.126:33167/ using document root <none> and password file <none>
I20260811 07:07:09.228899 17518 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:09.229053 17518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:09.235973 17518 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:07:09.239565 17538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:09.241245 17518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:07:09.241482 17518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "bc42e23ce67641dda8a338e91fea665f"
format_stamp: "Formatted at 2026-08-11 07:06:22 on dist-test-slave-69rg"
server_key: "481608a6c168b0fb68c66282f440ad19"
server_key_iv: "cf74e3a820069f7b53f93a1611fcf174"
server_key_version: "encryptionkey@0"
I20260811 07:07:09.242690 17518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:09.271075 17518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:09.277086 17518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:09.277433 17518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:09.302727 17518 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:36239
I20260811 07:07:09.302747 17597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:36239 every 8 connection(s)
I20260811 07:07:09.304738 17518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:09.311146 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 17518
I20260811 07:07:09.312387 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:35709
--local_ip_for_outbound_sockets=127.30.73.65
--tserver_master_addrs=127.30.73.126:36239
--webserver_port=44461
--webserver_interface=127.30.73.65
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:07:09.314080 17598 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:07:09.318384 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Bootstrap starting.
I20260811 07:07:09.348183 17598 log.cc:824] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:09.372608 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:07:09.373404 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Bootstrap complete.
I20260811 07:07:09.385008 17598 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:07:09.386293 17598 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc42e23ce67641dda8a338e91fea665f, State: Initialized, Role: FOLLOWER
I20260811 07:07:09.387212 17598 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:07:09.387526 17598 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:09.387681 17598 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:09.387887 17598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:07:09.392772 17598 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:07:09.393486 17598 leader_election.cc:302] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc42e23ce67641dda8a338e91fea665f; no voters:
I20260811 07:07:09.394356 17598 leader_election.cc:288] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 07:07:09.394610 17604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:07:09.396070 17604 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [term 3 LEADER]: Becoming Leader. State: Replica: bc42e23ce67641dda8a338e91fea665f, State: Running, Role: LEADER
I20260811 07:07:09.396890 17604 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } }
I20260811 07:07:09.397107 17598 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:09.400758 17605 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "bc42e23ce67641dda8a338e91fea665f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } } }
I20260811 07:07:09.400714 17606 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc42e23ce67641dda8a338e91fea665f. Latest consensus state: current_term: 3 leader_uuid: "bc42e23ce67641dda8a338e91fea665f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc42e23ce67641dda8a338e91fea665f" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 36239 } } }
I20260811 07:07:09.401383 17605 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:09.401392 17606 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:09.415642 17609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:09.428756 17609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:09.431455 17609 catalog_manager.cc:1259] Loaded cluster ID: e3c7c6c2eea54130ad8fbe546dfc9ba3
I20260811 07:07:09.431742 17609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:09.438534 17609 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:09.441313 17609 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Loaded TSK: 0
I20260811 07:07:09.441535 17609 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bc42e23ce67641dda8a338e91fea665f: Loaded TSK: 1
F20260811 07:07:09.443233 17609 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff83d8d89ad google::LogMessage::Fail() at ??:0
@ 0x7ff83d8db88a google::LogMessage::SendToLog() at ??:0
@ 0x7ff83d8d84de google::LogMessage::Flush() at ??:0
@ 0x7ff83d8d9a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff84163c7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7ff84162b73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7ff8533071c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7ff853306783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7ff8533922a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7ff8533920c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7ff8533dc5e9 std::function<>::operator()() at ??:0
@ 0x7ff85330acdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7ff853308c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff853390610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7ff853390439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7ff840524345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff84052791c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7ff840527799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7ff840502eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff8437dc6db start_thread at ??:0
@ 0x7ff83c77261f clone at ??:0
W20260811 07:07:09.812752 17601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:09.813055 17601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:09.813252 17601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:09.820709 17601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:09.820827 17601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:09.821019 17601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:07:09.831130 17601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:35709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=44461
--tserver_master_addrs=127.30.73.126:36239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:09.832690 17601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:09.834187 17601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:09.848369 17656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:09.848372 17657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:09.848505 17660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:09.849665 17601 server_base.cc:1034] running on GCE node
I20260811 07:07:09.850340 17601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:09.851337 17601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:09.852643 17601 hybrid_clock.cc:648] HybridClock initialized: now 1786432029852584 us; error 63 us; skew 500 ppm
I20260811 07:07:09.853013 17601 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:09 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432029, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:09.856520 17601 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:07:09.858139 17601 webserver.cc:460] Webserver started at http://127.30.73.65:44461/ using document root <none> and password file <none>
I20260811 07:07:09.858880 17601 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:09.859040 17601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:09.864711 17601 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 07:07:09.868000 17668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:09.869453 17601 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:07:09.869654 17601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "93c2d47f822a498bad23e95f8d463f83"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "075911c749d6373ede29fd9510e0e4fe"
server_key_iv: "a3188f9e7995d1b1f09d6b63daf8d48c"
server_key_version: "encryptionkey@0"
I20260811 07:07:09.871157 17601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:09.893718 17601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:09.899008 17601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:09.899466 17601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:09.900627 17601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:09.903342 17675 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260811 07:07:09.909657 17601 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:07:09.909879 17601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.001s
I20260811 07:07:09.910056 17601 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:07:09.913386 17601 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:07:09.913489 17601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260811 07:07:09.913875 17675 tablet_bootstrap.cc:492] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Bootstrap starting.
I20260811 07:07:09.925379 17675 log.cc:824] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:09.941937 17675 tablet_bootstrap.cc:492] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:07:09.942667 17675 tablet_bootstrap.cc:492] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Bootstrap complete.
I20260811 07:07:09.943167 17675 ts_tablet_manager.cc:1397] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Time spent bootstrapping tablet: real 0.030s user 0.020s sys 0.008s
I20260811 07:07:09.953157 17675 raft_consensus.cc:348] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:07:09.954994 17675 raft_consensus.cc:729] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93c2d47f822a498bad23e95f8d463f83, State: Initialized, Role: FOLLOWER
I20260811 07:07:09.955866 17675 consensus_queue.cc:260] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:07:09.957916 17675 ts_tablet_manager.cc:1428] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83: Time spent starting tablet: real 0.015s user 0.010s sys 0.005s
I20260811 07:07:09.964056 17601 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:35709
I20260811 07:07:09.964097 17799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:35709 every 8 connection(s)
I20260811 07:07:09.965356 17601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:07:09.967991 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 17601
I20260811 07:07:09.968730 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:36769
--local_ip_for_outbound_sockets=127.30.73.66
--tserver_master_addrs=127.30.73.126:36239
--webserver_port=35689
--webserver_interface=127.30.73.66
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:07:09.970881 17802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:09.968584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:43419)
0811 07:07:09.969630 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:09.969966 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":736,"thread_start_us":515,"threads_started":1}
W20260811 07:07:09.971566 17800 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:36239 (0 consecutive failures): Network error: Failed to ping master at 127.30.73.126:36239: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
I20260811 07:07:09.972554 17802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:09.972168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:48693)
0811 07:07:09.972356 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:09.972445 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 07:07:09.973599 17802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:09.973131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:40761)
0811 07:07:09.973325 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:09.973430 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 07:07:09.973961 17800 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:07:10.335381 17805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:10.335708 17805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:10.335889 17805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:10.343472 17805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:10.343596 17805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:10.343788 17805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:07:10.354102 17805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:36769
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=35689
--tserver_master_addrs=127.30.73.126:36239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:10.355726 17805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:10.357198 17805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:10.371848 17812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:10.371877 17813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:10.371840 17815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:10.373413 17805 server_base.cc:1034] running on GCE node
I20260811 07:07:10.374250 17805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:10.375622 17805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:10.376878 17805 hybrid_clock.cc:648] HybridClock initialized: now 1786432030376822 us; error 42 us; skew 500 ppm
I20260811 07:07:10.377314 17805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:10 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432030, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:10.381057 17805 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:07:10.382871 17805 webserver.cc:460] Webserver started at http://127.30.73.66:35689/ using document root <none> and password file <none>
I20260811 07:07:10.383706 17805 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:10.383872 17805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:10.389644 17805 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:07:10.393201 17823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:10.394733 17805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:07:10.394935 17805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "5d1cc410ce164b7a9bacd3e74851a975"
format_stamp: "Formatted at 2026-08-11 07:06:23 on dist-test-slave-69rg"
server_key: "8463432c7977b0cdd65b576db1993240"
server_key_iv: "4801d5e8ec816b280bdcc55c174453bc"
server_key_version: "encryptionkey@0"
I20260811 07:07:10.395983 17805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:10.412856 17805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:10.417536 17805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:10.417943 17805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:10.419090 17805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:10.420539 17805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:10.420673 17805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:10.420822 17805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:10.420918 17805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:10.456768 17805 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:36769
I20260811 07:07:10.456806 17948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:36769 every 8 connection(s)
I20260811 07:07:10.458539 17805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:07:10.463495 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 17805
I20260811 07:07:10.464241 17953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:10.461780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:42155)
0811 07:07:10.462680 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:10.462969 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":336,"threads_started":1}
I20260811 07:07:10.464321 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:41755
--local_ip_for_outbound_sockets=127.30.73.67
--tserver_master_addrs=127.30.73.126:36239
--webserver_port=37613
--webserver_interface=127.30.73.67
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:10.465256 17949 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:36239 (0 consecutive failures): Network error: Failed to ping master at 127.30.73.126:36239: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
I20260811 07:07:10.466490 17953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:10.465996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:52019)
0811 07:07:10.466206 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:10.466322 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 07:07:10.467788 17953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:10.467330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:50589)
0811 07:07:10.467513 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:10.467623 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 07:07:10.468137 17949 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:07:10.834439 17954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:10.834772 17954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:10.834873 17954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:10.842774 17954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:10.842931 17954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:10.843050 17954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:07:10.853330 17954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:41755
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=37613
--tserver_master_addrs=127.30.73.126:36239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:10.854761 17954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:10.856112 17954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:10.870828 17960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:10.870877 17963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:10.870800 17961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:10.871805 17954 server_base.cc:1034] running on GCE node
I20260811 07:07:10.872529 17954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:10.874110 17954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:10.875391 17954 hybrid_clock.cc:648] HybridClock initialized: now 1786432030875324 us; error 57 us; skew 500 ppm
I20260811 07:07:10.876051 17954 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:10 dist-test-slave-69rg krb5kdc[16261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432030, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:10.880051 17954 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:07:10.881736 17954 webserver.cc:460] Webserver started at http://127.30.73.67:37613/ using document root <none> and password file <none>
I20260811 07:07:10.882490 17954 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:10.882648 17954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:10.888712 17954 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:07:10.891675 17971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:10.893134 17954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:07:10.893333 17954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "b7fa9a15bb5c473c8c716a68274da658"
format_stamp: "Formatted at 2026-08-11 07:06:24 on dist-test-slave-69rg"
server_key: "fa3d609fdabe4d9d3c0ae289ed3abc3f"
server_key_iv: "008a7b4f0a530b2287946c2c1535367c"
server_key_version: "encryptionkey@0"
I20260811 07:07:10.894515 17954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:10.931557 17954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:10.936072 17954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:10.936367 17954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:10.937435 17954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:10.938928 17954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:10.939059 17954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:10.939204 17954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:10.939303 17954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:10.975487 17954 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:41755
I20260811 07:07:10.975656 18101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:10.974553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:56109)
0811 07:07:10.975331 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:10.975416 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":514,"threads_started":1}
I20260811 07:07:10.975548 18103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:41755 every 8 connection(s)
I20260811 07:07:10.977097 17954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:07:10.980170 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 17954
I20260811 07:07:10.982453 18106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:10.980164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:47087)
0811 07:07:10.981072 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:10.981379 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":407,"threads_started":1}
W20260811 07:07:10.983170 18104 heartbeater.cc:644] Failed to heartbeat to 127.30.73.126:36239 (0 consecutive failures): Network error: Failed to ping master at 127.30.73.126:36239: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
I20260811 07:07:10.984040 18106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:10.983727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:46549)
0811 07:07:10.983863 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:10.983932 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 07:07:10.984910 18106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:10.984599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:35695)
0811 07:07:10.984728 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:10.984802 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 07:07:10.985198 18104 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:07:11.367352 18108 raft_consensus.cc:482] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:11.367812 18108 raft_consensus.cc:504] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:07:11.369896 18108 leader_election.cc:288] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769), b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755)
Aug 11 07:07:11 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432029, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
Aug 11 07:07:11 dist-test-slave-69rg krb5kdc[16261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432029, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:07:11.395948 18101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:11.370242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:36769 (local address 127.30.73.65:59481)
0811 07:07:11.370451 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:11.370501 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:11.371194 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:11.377079 (+ 5885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:11.377090 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:11.377909 (+ 819us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:11.378808 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:11.378836 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:11.380884 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:11.380888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:11.382649 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:11.382664 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:11.384167 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:11.384174 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:11.384377 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:11.385114 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:11.385141 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:11.387694 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:11.392118 (+ 4424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:11.392128 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:11.392143 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:11.392629 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:11.393204 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:11.393208 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:11.393210 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:11.393379 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:11.394469 (+ 1090us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:11.394475 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:11.394771 (+ 296us) client_negotiation.cc:769] Sending connection context
0811 07:07:11.395140 (+ 369us) client_negotiation.cc:240] Negotiation successful
0811 07:07:11.395651 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 07:07:11.396216 18109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:11.370503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:59481 (local address 127.30.73.66:36769)
0811 07:07:11.374347 (+ 3844us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:11.374360 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:11.374396 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:07:11.376028 (+ 1632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:11.376038 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:11.376562 (+ 524us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:11.376921 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:11.379082 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:11.380677 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:11.382854 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:11.383896 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:11.384088 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:11.388021 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:11.388035 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:11.388055 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:11.388107 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:11.391953 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:11.392798 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:11.392805 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:11.392810 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:11.393066 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:11.393514 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:11.393519 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:11.393522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:11.394309 (+ 787us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:11.394513 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:11.395355 (+ 842us) server_negotiation.cc:299] Negotiation successful
0811 07:07:11.395756 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3651,"thread_start_us":3529,"threads_started":1}
I20260811 07:07:11.398079 18110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:11.370674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41755 (local address 127.30.73.65:39603)
0811 07:07:11.378825 (+ 8151us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:11.378849 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:11.378999 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:11.381653 (+ 2654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:11.381658 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:11.382362 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:11.382764 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:11.382778 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:11.384803 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:11.384807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:11.385916 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:11.385929 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:11.386921 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:11.386928 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:11.387104 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:11.387741 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:11.387759 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:11.390350 (+ 2591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:11.394907 (+ 4557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:11.394912 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:11.394915 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:11.395479 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:11.396045 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:11.396050 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:11.396053 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:11.396268 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:11.397054 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:11.397061 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:11.397225 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 07:07:11.397362 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 07:07:11.397640 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8004,"thread_start_us":7813,"threads_started":1}
I20260811 07:07:11.398679 18111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:11.371039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:39603 (local address 127.30.73.67:41755)
0811 07:07:11.378422 (+ 7383us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:11.378436 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:11.378967 (+ 531us) server_negotiation.cc:407] Connection header received
0811 07:07:11.381027 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:11.381036 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:11.381376 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:11.381626 (+ 250us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:11.382942 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:11.384616 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:11.386064 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:11.386705 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:11.386915 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:11.390665 (+ 3750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:11.390678 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:11.390697 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:11.390744 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:11.394765 (+ 4021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:11.395645 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:11.395655 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:11.395664 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:11.395905 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:11.396436 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:11.396443 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:11.396446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:11.396916 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:11.397121 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:11.397686 (+ 565us) server_negotiation.cc:299] Negotiation successful
0811 07:07:11.398211 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7178,"thread_start_us":7005,"threads_started":1}
W20260811 07:07:11.399559 17672 leader_election.cc:341] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769): Not found: Tablet not found: 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
W20260811 07:07:11.401073 17672 leader_election.cc:341] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755): Not found: Tablet not found: 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
I20260811 07:07:11.401257 17672 leader_election.cc:302] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93c2d47f822a498bad23e95f8d463f83; no voters: 5d1cc410ce164b7a9bacd3e74851a975, b7fa9a15bb5c473c8c716a68274da658
I20260811 07:07:11.401750 18108 raft_consensus.cc:2726] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:07:11.469753 18112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:11.468748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:42033)
0811 07:07:11.469305 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:11.469462 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":234,"threads_started":1}
I20260811 07:07:11.977661 18113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:11.976695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:51411)
0811 07:07:11.977294 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:11.977424 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":299,"threads_started":1}
I20260811 07:07:11.986910 18114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:11.985908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:44037)
0811 07:07:11.986498 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:11.986658 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":269,"threads_started":1}
I20260811 07:07:12.472214 18116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:12.471189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:34923)
0811 07:07:12.471848 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:12.471996 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":377,"threads_started":1}
I20260811 07:07:12.980225 18118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:12.979141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:50677)
0811 07:07:12.979794 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:12.979915 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":339,"threads_started":1}
I20260811 07:07:12.989466 18119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:12.988357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:50021)
0811 07:07:12.989108 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:12.989230 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":434,"threads_started":1}
I20260811 07:07:13.474884 18120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:13.473746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:52701)
0811 07:07:13.474526 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:13.474653 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":427,"threads_started":1}
I20260811 07:07:13.580384 18121 raft_consensus.cc:482] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:13.580687 18121 raft_consensus.cc:504] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:07:13.581636 18121 leader_election.cc:288] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769), b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755)
W20260811 07:07:13.583161 17672 leader_election.cc:341] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769): Not found: Tablet not found: 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
W20260811 07:07:13.583477 17672 leader_election.cc:341] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755): Not found: Tablet not found: 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
I20260811 07:07:13.583608 17672 leader_election.cc:302] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93c2d47f822a498bad23e95f8d463f83; no voters: 5d1cc410ce164b7a9bacd3e74851a975, b7fa9a15bb5c473c8c716a68274da658
I20260811 07:07:13.583953 18121 raft_consensus.cc:2726] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:07:13.982414 18122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:13.981444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:53829)
0811 07:07:13.982061 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:13.982176 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":278,"threads_started":1}
I20260811 07:07:13.992043 18123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:13.991005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:33825)
0811 07:07:13.991702 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:13.991823 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":398,"threads_started":1}
I20260811 07:07:14.477141 18124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:14.476236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:45835)
0811 07:07:14.476801 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:14.476900 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":317,"threads_started":1}
I20260811 07:07:14.984710 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:14.983718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:40455)
0811 07:07:14.984309 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:14.984462 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":280,"threads_started":1}
I20260811 07:07:14.994146 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:14.993197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:40133)
0811 07:07:14.993726 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:14.993886 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":261,"threads_started":1}
I20260811 07:07:15.479280 18128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:15.478358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:38487)
0811 07:07:15.478943 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:15.479058 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":307,"threads_started":1}
I20260811 07:07:15.763480 18129 raft_consensus.cc:482] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:15.763756 18129 raft_consensus.cc:504] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:07:15.764551 18129 leader_election.cc:288] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769), b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755)
W20260811 07:07:15.766270 17672 leader_election.cc:341] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755): Not found: Tablet not found: 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
W20260811 07:07:15.766602 17672 leader_election.cc:341] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769): Not found: Tablet not found: 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
I20260811 07:07:15.766785 17672 leader_election.cc:302] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93c2d47f822a498bad23e95f8d463f83; no voters: 5d1cc410ce164b7a9bacd3e74851a975, b7fa9a15bb5c473c8c716a68274da658
I20260811 07:07:15.767151 18129 raft_consensus.cc:2726] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:07:15.987367 18130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:15.986305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:56339)
0811 07:07:15.986984 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:15.987105 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":340,"threads_started":1}
I20260811 07:07:15.996539 18131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:15.995500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:46617)
0811 07:07:15.996169 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:15.996287 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":379,"threads_started":1}
I20260811 07:07:16.481954 18132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:16.480789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:54311)
0811 07:07:16.481536 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:16.481659 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":409,"threads_started":1}
I20260811 07:07:16.990021 18133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:16.988853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:46965)
0811 07:07:16.989558 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:16.989704 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":387,"threads_started":1}
I20260811 07:07:16.999042 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:16.998038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:34953)
0811 07:07:16.998632 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:16.998745 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":292,"threads_started":1}
I20260811 07:07:17.484195 18135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:17.483086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:34149)
0811 07:07:17.483823 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:17.483935 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":345,"threads_started":1}
I20260811 07:07:17.993189 18137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:17.992107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:55799)
0811 07:07:17.992780 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:17.992895 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":365,"threads_started":1}
I20260811 07:07:18.001747 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:18.000452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:55373)
0811 07:07:18.001241 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:18.001406 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":394,"threads_started":1}
I20260811 07:07:18.486929 18139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:18.485798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:59199)
0811 07:07:18.486556 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:18.486676 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":402,"threads_started":1}
I20260811 07:07:18.995565 18140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:18.994632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:57667)
0811 07:07:18.995209 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:18.995317 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":289,"threads_started":1}
I20260811 07:07:19.004283 18141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:19.003415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:32991)
0811 07:07:19.003950 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:19.004054 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":285,"threads_started":1}
I20260811 07:07:19.489210 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:19.488262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:49897)
0811 07:07:19.488889 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:19.489001 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":342,"threads_started":1}
I20260811 07:07:19.998034 18143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:19.996914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:60177)
0811 07:07:19.997535 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:19.997655 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":318,"threads_started":1}
I20260811 07:07:20.007028 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:20.005651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:54417)
0811 07:07:20.006647 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:20.006801 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":611,"threads_started":1}
I20260811 07:07:20.030485 18146 raft_consensus.cc:482] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:20.030802 18146 raft_consensus.cc:504] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93c2d47f822a498bad23e95f8d463f83" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 35709 } } peers { permanent_uuid: "5d1cc410ce164b7a9bacd3e74851a975" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 36769 } } peers { permanent_uuid: "b7fa9a15bb5c473c8c716a68274da658" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41755 } }
I20260811 07:07:20.031736 18146 leader_election.cc:288] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769), b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755)
W20260811 07:07:20.033015 17672 leader_election.cc:341] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d1cc410ce164b7a9bacd3e74851a975 (127.30.73.66:36769): Not found: Tablet not found: 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
W20260811 07:07:20.033241 17672 leader_election.cc:341] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b7fa9a15bb5c473c8c716a68274da658 (127.30.73.67:41755): Not found: Tablet not found: 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4
I20260811 07:07:20.033318 17672 leader_election.cc:302] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93c2d47f822a498bad23e95f8d463f83; no voters: 5d1cc410ce164b7a9bacd3e74851a975, b7fa9a15bb5c473c8c716a68274da658
I20260811 07:07:20.033593 18146 raft_consensus.cc:2726] T 0e1ff8cb571f4cd4bb4f6dbc7f4df1b4 P 93c2d47f822a498bad23e95f8d463f83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:07:20.492074 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:20.490517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:36345)
0811 07:07:20.491386 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:20.491725 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":396,"threads_started":1}
I20260811 07:07:21.000449 18148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:20.999486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:33685)
0811 07:07:21.000048 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:21.000155 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":287,"threads_started":1}
I20260811 07:07:21.009945 18149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:21.008724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:45009)
0811 07:07:21.009351 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:21.009478 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":337,"threads_started":1}
I20260811 07:07:21.494956 18150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:21.493925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:39125)
0811 07:07:21.494611 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:21.494724 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":399,"threads_started":1}
I20260811 07:07:22.002915 18152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:22.001966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:54245)
0811 07:07:22.002540 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:22.002665 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":297,"threads_started":1}
I20260811 07:07:22.012794 18153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:22.011566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:40635)
0811 07:07:22.012445 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:22.012574 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":726,"thread_start_us":571,"threads_started":1}
I20260811 07:07:22.497073 18154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:22.496069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:55359)
0811 07:07:22.496710 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:22.496826 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":334,"threads_started":1}
I20260811 07:07:23.005180 18155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:23.004190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:33479)
0811 07:07:23.004802 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:23.004947 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":324,"threads_started":1}
I20260811 07:07:23.015455 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:23.014182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:57163)
0811 07:07:23.014944 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:23.015193 (+ 249us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":362,"threads_started":1}
I20260811 07:07:23.499841 18157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:23.498521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:59065)
0811 07:07:23.499201 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:23.499378 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":342,"threads_started":1}
I20260811 07:07:24.008019 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:24.006853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:34861)
0811 07:07:24.007496 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:24.007741 (+ 245us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":322,"threads_started":1}
I20260811 07:07:24.018788 18159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:24.016814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:34577)
0811 07:07:24.018373 (+ 1559us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:24.018547 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1438,"thread_start_us":1282,"threads_started":1}
I20260811 07:07:24.502437 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:24.501313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:35661)
0811 07:07:24.502039 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:24.502151 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":368,"threads_started":1}
I20260811 07:07:25.011551 18162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:25.010311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:53747)
0811 07:07:25.011152 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:25.011306 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":437,"threads_started":1}
I20260811 07:07:25.021199 18163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:25.020143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:41545)
0811 07:07:25.020835 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:25.020948 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":400,"threads_started":1}
I20260811 07:07:25.504804 18164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:25.503867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.66:52287)
0811 07:07:25.504420 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:25.504593 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":270,"threads_started":1}
I20260811 07:07:25.989085 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 17601
I20260811 07:07:26.014395 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:26.012998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.65:44671)
0811 07:07:26.013877 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:26.014058 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":446,"threads_started":1}
I20260811 07:07:26.018991 18165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:25.991466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58966 (local address 127.30.73.65:35709)
0811 07:07:25.992182 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:25.992191 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:25.992224 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:07:25.992307 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:25.992316 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:25.992647 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:25.992808 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:25.994703 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:25.995832 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:25.997297 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:25.998056 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:25.998179 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:26.011065 (+ 12886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:26.011093 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:26.011117 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:26.011181 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:26.015570 (+ 4389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:26.016555 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:26.016565 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:26.016567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:26.016731 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:26.017136 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:26.017139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:26.017141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:26.017564 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:26.017898 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:26.018353 (+ 455us) server_negotiation.cc:299] Negotiation successful
0811 07:07:26.018652 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":344,"threads_started":1}
I20260811 07:07:26.020625 17795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:26.023949 18169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:26.022680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:36239 (local address 127.30.73.67:55409)
0811 07:07:26.023411 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:26.023623 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.126:36239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":334,"threads_started":1}
I20260811 07:07:26.130987 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 17601
I20260811 07:07:26.158692 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 17805
I20260811 07:07:26.175371 18170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:26.159799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48094 (local address 127.30.73.66:36769)
0811 07:07:26.160343 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:26.160348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:26.160369 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:07:26.160443 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:26.160447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:26.160518 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:26.160625 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:26.162538 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:26.163471 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:26.164894 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:26.165381 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:26.165565 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:26.169379 (+ 3814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:26.169428 (+ 49us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:26.169433 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:26.169484 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:26.172469 (+ 2985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:26.173177 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:26.173182 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:26.173192 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:26.173342 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:26.173747 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:26.173751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:26.173754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:26.174169 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:26.174429 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:26.174684 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 07:07:26.174894 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":283,"threads_started":1}
I20260811 07:07:26.176308 17944 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:26.270370 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 17805
I20260811 07:07:26.297597 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 17954
I20260811 07:07:26.315066 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:26.298914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51068 (local address 127.30.73.67:41755)
0811 07:07:26.299714 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:26.299719 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:26.299738 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:07:26.299807 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:26.299811 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:26.299885 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:26.300034 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:26.301690 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:26.302738 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:26.304093 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:26.304566 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:26.304721 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:26.307852 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:26.307858 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:26.307862 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:26.307906 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:26.311351 (+ 3445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:26.312300 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:26.312308 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:26.312315 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:26.312511 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:26.312972 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:26.312978 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:26.312984 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:26.313325 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:26.313709 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:26.314223 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 07:07:26.314532 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":376,"threads_started":1}
I20260811 07:07:26.316066 18098 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:26.410041 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 17954
2026-08-11T07:07:26Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (66114 ms)
[----------] 30 tests from SecurityITest (324174 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:07:26 dist-test-slave-69rg krb5kdc[18177](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:07:26 dist-test-slave-69rg krb5kdc[18177](info): set up 2 sockets
Aug 11 07:07:26 dist-test-slave-69rg krb5kdc[18177](info): commencing operation
krb5kdc: starting...
W20260811 07:07:27.675745 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.003s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:07:27 dist-test-slave-69rg krb5kdc[18177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:07:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:07:28.008493 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:42907
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:42907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:28.377532 18191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:28.377923 18191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:28.378113 18191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:28.386089 18191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:28.386255 18191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:28.386363 18191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:28.386478 18191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:28.386559 18191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:28.396937 18191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:42907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:42907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:28.398427 18191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:28.399883 18191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:28.411924 18197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:28.411996 18201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:28.411979 18198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:28.413393 18191 server_base.cc:1034] running on GCE node
I20260811 07:07:28.414407 18191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:28.415935 18191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:28.417196 18191 hybrid_clock.cc:648] HybridClock initialized: now 1786432048417176 us; error 79 us; skew 500 ppm
I20260811 07:07:28.417598 18191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:28 dist-test-slave-69rg krb5kdc[18177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432048, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:28.420969 18191 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:07:28.422616 18191 webserver.cc:460] Webserver started at http://127.30.73.126:41535/ using document root <none> and password file <none>
I20260811 07:07:28.423298 18191 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:28.423404 18191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:28.423663 18191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:28.427126 18191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "c6ce2d47a12146c0980e7cd9a7da4a88"
format_stamp: "Formatted at 2026-08-11 07:07:28 on dist-test-slave-69rg"
server_key: "c23da80dbd6ccb630d56d693387d39e0"
server_key_iv: "1d968256ffcb8373789555f5c31abb55"
server_key_version: "encryptionkey@0"
I20260811 07:07:28.427904 18191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "c6ce2d47a12146c0980e7cd9a7da4a88"
format_stamp: "Formatted at 2026-08-11 07:07:28 on dist-test-slave-69rg"
server_key: "c23da80dbd6ccb630d56d693387d39e0"
server_key_iv: "1d968256ffcb8373789555f5c31abb55"
server_key_version: "encryptionkey@0"
I20260811 07:07:28.433295 18191 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:07:28.436977 18209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:28.438474 18191 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:07:28.438664 18191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "c6ce2d47a12146c0980e7cd9a7da4a88"
format_stamp: "Formatted at 2026-08-11 07:07:28 on dist-test-slave-69rg"
server_key: "c23da80dbd6ccb630d56d693387d39e0"
server_key_iv: "1d968256ffcb8373789555f5c31abb55"
server_key_version: "encryptionkey@0"
I20260811 07:07:28.438887 18191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:28.457676 18191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:28.462716 18191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:28.463025 18191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:28.481987 18191 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:42907
I20260811 07:07:28.481990 18266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:42907 every 8 connection(s)
I20260811 07:07:28.483482 18191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:28.487481 18267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:28.491904 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 18191
I20260811 07:07:28.492161 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:07:28.493037 31013 external_mini_cluster.cc:1428] Setting key e81782279746e149277cfcb9125713ca
I20260811 07:07:28.499804 18267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88: Bootstrap starting.
I20260811 07:07:28.503558 18267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:28.504773 18267 log.cc:824] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:28.507694 18267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88: No bootstrap required, opened a new log
Aug 11 07:07:28 dist-test-slave-69rg krb5kdc[18177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:28.518639 18267 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ce2d47a12146c0980e7cd9a7da4a88" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42907 } }
I20260811 07:07:28.519132 18267 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:28.519249 18267 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ce2d47a12146c0980e7cd9a7da4a88, State: Initialized, Role: FOLLOWER
I20260811 07:07:28.519343 18272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:28.495283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38992 (local address 127.30.73.126:42907)
0811 07:07:28.496080 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:28.496092 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:28.496136 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:07:28.498362 (+ 2226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:28.498384 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:28.498757 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:28.499080 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:28.501040 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:28.502554 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:28.504447 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:28.505255 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:28.505483 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:28.509738 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:28.509753 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:28.509777 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:28.509854 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:28.514206 (+ 4352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:28.515049 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:28.515059 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:28.515068 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:28.515312 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:28.515790 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:28.515796 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:28.515800 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:28.516636 (+ 836us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:28.516950 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:28.517383 (+ 433us) server_negotiation.cc:299] Negotiation successful
0811 07:07:28.517910 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":378,"threads_started":1}
I20260811 07:07:28.519896 18267 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ce2d47a12146c0980e7cd9a7da4a88" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42907 } }
I20260811 07:07:28.520305 18267 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:28.520545 18267 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:28.520754 18267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:28.523705 18267 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ce2d47a12146c0980e7cd9a7da4a88" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42907 } }
I20260811 07:07:28.524158 18267 leader_election.cc:302] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6ce2d47a12146c0980e7cd9a7da4a88; no voters:
I20260811 07:07:28.524698 18267 leader_election.cc:288] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:07:28.524869 18275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:28.525784 18275 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [term 1 LEADER]: Becoming Leader. State: Replica: c6ce2d47a12146c0980e7cd9a7da4a88, State: Running, Role: LEADER
I20260811 07:07:28.526438 18275 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ce2d47a12146c0980e7cd9a7da4a88" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42907 } }
I20260811 07:07:28.526840 18267 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:28.529696 18278 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6ce2d47a12146c0980e7cd9a7da4a88. Latest consensus state: current_term: 1 leader_uuid: "c6ce2d47a12146c0980e7cd9a7da4a88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ce2d47a12146c0980e7cd9a7da4a88" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42907 } } }
I20260811 07:07:28.530679 18278 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:28.530303 18276 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6ce2d47a12146c0980e7cd9a7da4a88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ce2d47a12146c0980e7cd9a7da4a88" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42907 } } }
I20260811 07:07:28.531260 18276 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:28.533061 18288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:28.537994 18288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:28.547288 18288 catalog_manager.cc:1347] Generated new cluster ID: 7e17bbd8c60d45d2a942fc255233dba8
I20260811 07:07:28.547417 18288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:28.560438 18288 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:07:28.561976 18288 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:28.572922 18288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88: Generated new TSK 0
I20260811 07:07:28.573936 18288 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:07:28.666404 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42907
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:29.037412 18300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:29.037693 18300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:29.037870 18300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:29.045502 18300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:29.045621 18300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:29.045900 18300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:07:29.056094 18300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:29.057430 18300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:29.058863 18300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:29.073202 18305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:29.073241 18310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:29.073561 18306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:29.074631 18300 server_base.cc:1034] running on GCE node
I20260811 07:07:29.075420 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:29.076395 18300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:29.077682 18300 hybrid_clock.cc:648] HybridClock initialized: now 1786432049077618 us; error 59 us; skew 500 ppm
I20260811 07:07:29.078146 18300 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:29 dist-test-slave-69rg krb5kdc[18177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432049, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:29.081578 18300 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:07:29.083199 18300 webserver.cc:460] Webserver started at http://127.30.73.65:38079/ using document root <none> and password file <none>
I20260811 07:07:29.083873 18300 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:29.083982 18300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:29.084270 18300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:29.087532 18300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "7a4c1ea335f64037ba66af2302675563"
format_stamp: "Formatted at 2026-08-11 07:07:29 on dist-test-slave-69rg"
server_key: "0b7156fa4a107a3d2c30fc5727ceeca3"
server_key_iv: "4fd28278a3a08d6bf7b2064ff4307fbf"
server_key_version: "encryptionkey@0"
I20260811 07:07:29.088605 18300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "7a4c1ea335f64037ba66af2302675563"
format_stamp: "Formatted at 2026-08-11 07:07:29 on dist-test-slave-69rg"
server_key: "0b7156fa4a107a3d2c30fc5727ceeca3"
server_key_iv: "4fd28278a3a08d6bf7b2064ff4307fbf"
server_key_version: "encryptionkey@0"
I20260811 07:07:29.094678 18300 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.007s
I20260811 07:07:29.098326 18319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:29.099822 18300 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:07:29.100035 18300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "7a4c1ea335f64037ba66af2302675563"
format_stamp: "Formatted at 2026-08-11 07:07:29 on dist-test-slave-69rg"
server_key: "0b7156fa4a107a3d2c30fc5727ceeca3"
server_key_iv: "4fd28278a3a08d6bf7b2064ff4307fbf"
server_key_version: "encryptionkey@0"
I20260811 07:07:29.100262 18300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:29.135699 18300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:29.140182 18300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:29.140509 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:29.141605 18300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:29.143332 18300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:29.143442 18300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:29.143612 18300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:29.143688 18300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:29.180116 18300 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:45637
I20260811 07:07:29.180209 18449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:45637 every 8 connection(s)
I20260811 07:07:29.181458 18300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:07:29.187863 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 18300
I20260811 07:07:29.188100 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:07:29.188796 31013 external_mini_cluster.cc:1428] Setting key 215b7cd0603a5017061ad67d0de4c689
Aug 11 07:07:29 dist-test-slave-69rg krb5kdc[18177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432049, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:29.205960 18452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:29.184222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:51885 (local address 127.30.73.126:42907)
0811 07:07:29.184708 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:29.184713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:29.185626 (+ 913us) server_negotiation.cc:407] Connection header received
0811 07:07:29.187518 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:29.187524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:29.187621 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:29.187772 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:29.189391 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:29.190261 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:29.192044 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:29.192791 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:29.192946 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:29.197725 (+ 4779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:29.197736 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:29.197745 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:29.197800 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:29.201944 (+ 4144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:29.202917 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:29.202927 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:29.202934 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:29.203105 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:29.203615 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:29.203623 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:29.203629 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:29.204077 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:29.204261 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:29.205149 (+ 888us) server_negotiation.cc:299] Negotiation successful
0811 07:07:29.205450 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":237,"threads_started":1}
I20260811 07:07:29.206965 18453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:29.184781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:42907 (local address 127.30.73.65:51885)
0811 07:07:29.185459 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:29.185504 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:29.187244 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:29.187953 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:29.187960 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:29.188581 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:29.189204 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:29.189221 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:29.190428 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:29.190434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:29.191890 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:29.191903 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:29.193028 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:29.193033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:29.193242 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:29.194016 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:29.194052 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:29.197413 (+ 3361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:29.202123 (+ 4710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:29.202136 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:29.202156 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:29.202767 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:29.203236 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:29.203243 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:29.203249 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:29.203487 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:29.204226 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:29.204236 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:29.204700 (+ 464us) client_negotiation.cc:769] Sending connection context
0811 07:07:29.205063 (+ 363us) client_negotiation.cc:240] Negotiation successful
0811 07:07:29.205630 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":275,"threads_started":1}
I20260811 07:07:29.208683 18450 heartbeater.cc:347] Connected to a master server at 127.30.73.126:42907
I20260811 07:07:29.209023 18450 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:29.209946 18450 heartbeater.cc:511] Master 127.30.73.126:42907 requested a full tablet report, sending...
I20260811 07:07:29.212293 18227 ts_manager.cc:194] Registered new tserver with Master: 7a4c1ea335f64037ba66af2302675563 (127.30.73.65:45637)
I20260811 07:07:29.213804 18227 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:51885
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:07:29.270586 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42907
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:29.627821 18460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:29.628122 18460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:29.628333 18460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:29.635836 18460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:29.635941 18460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:29.636054 18460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:07:29.646106 18460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:29.647441 18460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:29.648716 18460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:29.662639 18466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:29.662549 18467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:29.662609 18470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:29.663870 18460 server_base.cc:1034] running on GCE node
I20260811 07:07:29.664597 18460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:29.665639 18460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:29.666864 18460 hybrid_clock.cc:648] HybridClock initialized: now 1786432049666827 us; error 65 us; skew 500 ppm
I20260811 07:07:29.667269 18460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:29 dist-test-slave-69rg krb5kdc[18177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432049, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:29.670928 18460 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:07:29.672652 18460 webserver.cc:460] Webserver started at http://127.30.73.66:38573/ using document root <none> and password file <none>
I20260811 07:07:29.673439 18460 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:29.673592 18460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:29.674039 18460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:29.677327 18460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "a71aba5b89d74670bcac396b9b405a7c"
format_stamp: "Formatted at 2026-08-11 07:07:29 on dist-test-slave-69rg"
server_key: "b33e1783da8d3fa651e673549780c97d"
server_key_iv: "0503aebdfdf6654fb1c7b3c5326b4893"
server_key_version: "encryptionkey@0"
I20260811 07:07:29.678279 18460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "a71aba5b89d74670bcac396b9b405a7c"
format_stamp: "Formatted at 2026-08-11 07:07:29 on dist-test-slave-69rg"
server_key: "b33e1783da8d3fa651e673549780c97d"
server_key_iv: "0503aebdfdf6654fb1c7b3c5326b4893"
server_key_version: "encryptionkey@0"
I20260811 07:07:29.684024 18460 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:07:29.687978 18478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:29.689421 18460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:07:29.689625 18460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "a71aba5b89d74670bcac396b9b405a7c"
format_stamp: "Formatted at 2026-08-11 07:07:29 on dist-test-slave-69rg"
server_key: "b33e1783da8d3fa651e673549780c97d"
server_key_iv: "0503aebdfdf6654fb1c7b3c5326b4893"
server_key_version: "encryptionkey@0"
I20260811 07:07:29.689927 18460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:29.706405 18460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:29.711094 18460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:29.711390 18460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:29.712539 18460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:29.714172 18460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:29.714303 18460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:29.714478 18460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:29.714564 18460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:29.754033 18460 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:39819
I20260811 07:07:29.754127 18613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:39819 every 8 connection(s)
I20260811 07:07:29.755509 18460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:07:29.764012 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 18460
I20260811 07:07:29.764235 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:07:29.764817 31013 external_mini_cluster.cc:1428] Setting key 99143da9f0a7158c7bcc597ebdaae357
Aug 11 07:07:29 dist-test-slave-69rg krb5kdc[18177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432049, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:29.780622 18616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:29.758360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:43297 (local address 127.30.73.126:42907)
0811 07:07:29.758860 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:29.758865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:29.759903 (+ 1038us) server_negotiation.cc:407] Connection header received
0811 07:07:29.762039 (+ 2136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:29.762045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:29.762153 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:29.762288 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:29.763962 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:29.764962 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:29.767472 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:29.767994 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:29.768177 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:29.772164 (+ 3987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:29.772174 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:29.772182 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:29.772247 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:29.776462 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:29.777364 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:29.777373 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:29.777379 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:29.777572 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:29.778209 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:29.778218 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:29.778224 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:29.778669 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:29.778848 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:29.779679 (+ 831us) server_negotiation.cc:299] Negotiation successful
0811 07:07:29.779999 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":248,"threads_started":1}
I20260811 07:07:29.781183 18617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:29.758923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:42907 (local address 127.30.73.66:43297)
0811 07:07:29.759723 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:29.759766 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:29.761697 (+ 1931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:29.762561 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:29.762570 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:29.763146 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:29.763759 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:29.763778 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:29.765151 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:29.765155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:29.767292 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:29.767317 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:29.768285 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:29.768293 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:29.768566 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:29.769361 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:29.769386 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:29.771891 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:29.776660 (+ 4769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:29.776678 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:29.776694 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:29.777202 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:29.777734 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:29.777738 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:29.777740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:29.778034 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:29.778848 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:29.778855 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:29.779266 (+ 411us) client_negotiation.cc:769] Sending connection context
0811 07:07:29.779512 (+ 246us) client_negotiation.cc:240] Negotiation successful
0811 07:07:29.779943 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":311,"threads_started":1}
I20260811 07:07:29.782913 18614 heartbeater.cc:347] Connected to a master server at 127.30.73.126:42907
I20260811 07:07:29.783269 18614 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:29.784094 18614 heartbeater.cc:511] Master 127.30.73.126:42907 requested a full tablet report, sending...
I20260811 07:07:29.785856 18227 ts_manager.cc:194] Registered new tserver with Master: a71aba5b89d74670bcac396b9b405a7c (127.30.73.66:39819)
I20260811 07:07:29.787199 18227 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:43297
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:07:29.841943 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42907
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:34091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:07:30.218084 18450 heartbeater.cc:503] Master 127.30.73.126:42907 was elected leader, sending a full tablet report...
W20260811 07:07:30.296892 18620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:30.297315 18620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:30.297539 18620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:30.306970 18620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:30.307161 18620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:30.307367 18620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:07:30.319964 18620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:34091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:42907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:30.321916 18620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:30.323709 18620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:30.341140 18627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:30.341176 18629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:30.341135 18632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:30.343050 18620 server_base.cc:1034] running on GCE node
I20260811 07:07:30.343971 18620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:30.345332 18620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:30.346642 18620 hybrid_clock.cc:648] HybridClock initialized: now 1786432050346544 us; error 72 us; skew 500 ppm
I20260811 07:07:30.347167 18620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:30 dist-test-slave-69rg krb5kdc[18177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432050, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:30.351572 18620 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:07:30.353720 18620 webserver.cc:460] Webserver started at http://127.30.73.67:39145/ using document root <none> and password file <none>
I20260811 07:07:30.354782 18620 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:30.354918 18620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:30.355293 18620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:30.359421 18620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "213b0d771a0641f7829173e8a50df70c"
format_stamp: "Formatted at 2026-08-11 07:07:30 on dist-test-slave-69rg"
server_key: "88f21aee61cf06562de8b6e8c0cc8f44"
server_key_iv: "2d58618696988be28e4fdf6020567ba9"
server_key_version: "encryptionkey@0"
I20260811 07:07:30.360420 18620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "213b0d771a0641f7829173e8a50df70c"
format_stamp: "Formatted at 2026-08-11 07:07:30 on dist-test-slave-69rg"
server_key: "88f21aee61cf06562de8b6e8c0cc8f44"
server_key_iv: "2d58618696988be28e4fdf6020567ba9"
server_key_version: "encryptionkey@0"
I20260811 07:07:30.367641 18620 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.006s
I20260811 07:07:30.372601 18642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:30.374672 18620 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:07:30.374931 18620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "213b0d771a0641f7829173e8a50df70c"
format_stamp: "Formatted at 2026-08-11 07:07:30 on dist-test-slave-69rg"
server_key: "88f21aee61cf06562de8b6e8c0cc8f44"
server_key_iv: "2d58618696988be28e4fdf6020567ba9"
server_key_version: "encryptionkey@0"
I20260811 07:07:30.375221 18620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:30.392292 18620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:30.397801 18620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:30.398231 18620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:30.399528 18620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:30.401315 18620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:30.401399 18620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:30.401574 18620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:30.401634 18620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:30.442719 18620 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:43961
I20260811 07:07:30.442760 18773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:43961 every 8 connection(s)
I20260811 07:07:30.444383 18620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:07:30.452684 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 18620
I20260811 07:07:30.452957 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:07:30.453665 31013 external_mini_cluster.cc:1428] Setting key a2d830c44be52c7c07c29cc2eae6a56e
Aug 11 07:07:30 dist-test-slave-69rg krb5kdc[18177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432050, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:30.471212 18776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.447999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:46271 (local address 127.30.73.126:42907)
0811 07:07:30.448635 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.448644 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.449947 (+ 1303us) server_negotiation.cc:407] Connection header received
0811 07:07:30.452227 (+ 2280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.452233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.452348 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.452466 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:30.455102 (+ 2636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.456350 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.458847 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.459303 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.459430 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.463723 (+ 4293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:30.463729 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:30.463733 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:30.463790 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:30.467033 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:30.467900 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:30.467904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:30.467907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:30.468064 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:30.468746 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:30.468751 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:30.468754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:30.469179 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:30.469366 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.470460 (+ 1094us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.470745 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":273,"threads_started":1}
I20260811 07:07:30.472505 18777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.448806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:42907 (local address 127.30.73.67:46271)
0811 07:07:30.449697 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:30.449754 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:30.451838 (+ 2084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:30.452831 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:30.452847 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:30.453788 (+ 941us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:30.454824 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.454859 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.456603 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.456608 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.458661 (+ 2053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.458678 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.459551 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.459556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.459808 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.460642 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:30.460672 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:30.463412 (+ 2740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:30.467226 (+ 3814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:30.467235 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:30.467254 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:30.467771 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:30.468286 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:30.468292 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:30.468294 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:30.468587 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:30.469328 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:30.469340 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:30.469939 (+ 599us) client_negotiation.cc:769] Sending connection context
0811 07:07:30.470330 (+ 391us) client_negotiation.cc:240] Negotiation successful
0811 07:07:30.471025 (+ 695us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":361,"threads_started":1}
I20260811 07:07:30.474253 18774 heartbeater.cc:347] Connected to a master server at 127.30.73.126:42907
I20260811 07:07:30.474658 18774 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:30.475566 18774 heartbeater.cc:511] Master 127.30.73.126:42907 requested a full tablet report, sending...
I20260811 07:07:30.477322 18227 ts_manager.cc:194] Registered new tserver with Master: 213b0d771a0641f7829173e8a50df70c (127.30.73.67:43961)
I20260811 07:07:30.478318 18227 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:46271
I20260811 07:07:30.483942 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:07:30.504459 18776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.489668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59730 (local address 127.30.73.126:42907)
0811 07:07:30.489917 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.489923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.490493 (+ 570us) server_negotiation.cc:407] Connection header received
0811 07:07:30.490664 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.490667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.490758 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.490853 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:30.492519 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.493347 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.494937 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.495358 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.495463 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.498206 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:30.498211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:30.498215 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:30.498259 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:30.501347 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:30.502192 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:30.502196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:30.502199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:30.502385 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:30.502802 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:30.502807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:30.502809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:30.503229 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:30.503565 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.503935 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.504169 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:07:30.509744 18227 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:07:30.518082 18227 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:07:30.546422 18793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.535731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.30.73.65:45637)
0811 07:07:30.536497 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.536505 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.536532 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:07:30.536683 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.536693 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.537052 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.539115 (+ 2063us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:30.539380 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.540832 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.543811 (+ 2979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.544902 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.545081 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.545434 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.545784 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.546029 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":418,"threads_started":1}
I20260811 07:07:30.546489 18792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.534923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:45637 (local address 127.0.0.1:40918)
0811 07:07:30.535619 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:30.535639 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:30.535764 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:30.538387 (+ 2623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:30.538391 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:30.538420 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:30.538876 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.538889 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.540999 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.541004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.543651 (+ 2647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.543662 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.545114 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.545120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.545318 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.545448 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 07:07:30.545731 (+ 283us) client_negotiation.cc:240] Negotiation successful
0811 07:07:30.545918 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":90,"thread_start_us":451,"threads_started":1}
I20260811 07:07:30.547097 18791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.533493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50508 (local address 127.30.73.67:43961)
0811 07:07:30.536784 (+ 3291us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.536794 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.536835 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:07:30.536963 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.536970 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.537208 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.537437 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:30.538323 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.540216 (+ 1893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.543413 (+ 3197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.545038 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.546133 (+ 1095us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.546391 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.546487 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.546693 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3074,"thread_start_us":3801,"threads_started":1}
I20260811 07:07:30.547315 18790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.533375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:43961 (local address 127.0.0.1:50508)
0811 07:07:30.534495 (+ 1120us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:30.534557 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:30.534752 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:30.537463 (+ 2711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:30.537471 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:30.537505 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:30.538059 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.538091 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.540377 (+ 2286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.540383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.543255 (+ 2872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.543268 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.545322 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.545329 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.545531 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.545563 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 07:07:30.545653 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 07:07:30.545898 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"mutex_wait_us":108,"thread_start_us":420,"threads_started":1}
I20260811 07:07:30.547873 18797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.536388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39819 (local address 127.0.0.1:50926)
0811 07:07:30.536934 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:30.536953 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:30.537065 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:30.538839 (+ 1774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:30.538844 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:30.538869 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:30.539264 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.539273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.540727 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.540735 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.543477 (+ 2742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.543497 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.546965 (+ 3468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.546975 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.547202 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.547253 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 07:07:30.547356 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 07:07:30.547497 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"mutex_wait_us":4,"thread_start_us":772,"threads_started":1}
I20260811 07:07:30.548669 18799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.536992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50926 (local address 127.30.73.66:39819)
0811 07:07:30.538267 (+ 1275us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.538275 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.538304 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:07:30.538414 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.538420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.538640 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.538838 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:30.539424 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.540569 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.543646 (+ 3077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.545203 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.545361 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.545569 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.548109 (+ 2540us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.548319 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1099,"thread_start_us":959,"threads_started":1}
I20260811 07:07:30.552170 18534 tablet_service.cc:1467] Processing CreateTablet for tablet 25ffaca27a6f45f28d29ab04a2660e1b (DEFAULT_TABLE table=test-table [id=c2f72dd7ad6d47e2b4e1491b08c9458e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:30.552093 18372 tablet_service.cc:1467] Processing CreateTablet for tablet 25ffaca27a6f45f28d29ab04a2660e1b (DEFAULT_TABLE table=test-table [id=c2f72dd7ad6d47e2b4e1491b08c9458e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:30.552093 18701 tablet_service.cc:1467] Processing CreateTablet for tablet 25ffaca27a6f45f28d29ab04a2660e1b (DEFAULT_TABLE table=test-table [id=c2f72dd7ad6d47e2b4e1491b08c9458e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:30.553766 18534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25ffaca27a6f45f28d29ab04a2660e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:30.553809 18372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25ffaca27a6f45f28d29ab04a2660e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:30.553838 18701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25ffaca27a6f45f28d29ab04a2660e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:30.570771 18800 tablet_bootstrap.cc:492] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: Bootstrap starting.
I20260811 07:07:30.576550 18800 tablet_bootstrap.cc:654] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:30.576627 18801 tablet_bootstrap.cc:492] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: Bootstrap starting.
I20260811 07:07:30.577709 18802 tablet_bootstrap.cc:492] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: Bootstrap starting.
I20260811 07:07:30.578562 18800 log.cc:824] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:30.582463 18800 tablet_bootstrap.cc:492] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: No bootstrap required, opened a new log
I20260811 07:07:30.582670 18802 tablet_bootstrap.cc:654] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:30.582847 18800 ts_tablet_manager.cc:1397] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20260811 07:07:30.583667 18801 tablet_bootstrap.cc:654] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:30.584292 18802 log.cc:824] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:30.585184 18801 log.cc:824] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:30.589802 18802 tablet_bootstrap.cc:492] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: No bootstrap required, opened a new log
I20260811 07:07:30.590337 18802 ts_tablet_manager.cc:1397] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260811 07:07:30.592415 18800 raft_consensus.cc:348] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } }
I20260811 07:07:30.592900 18800 raft_consensus.cc:374] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:30.593055 18800 raft_consensus.cc:729] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a71aba5b89d74670bcac396b9b405a7c, State: Initialized, Role: FOLLOWER
I20260811 07:07:30.593194 18801 tablet_bootstrap.cc:492] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: No bootstrap required, opened a new log
I20260811 07:07:30.593583 18801 ts_tablet_manager.cc:1397] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.007s
I20260811 07:07:30.594004 18800 consensus_queue.cc:260] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } }
I20260811 07:07:30.595459 18614 heartbeater.cc:503] Master 127.30.73.126:42907 was elected leader, sending a full tablet report...
I20260811 07:07:30.596151 18800 ts_tablet_manager.cc:1428] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: Time spent starting tablet: real 0.013s user 0.011s sys 0.002s
I20260811 07:07:30.603929 18802 raft_consensus.cc:348] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } }
I20260811 07:07:30.604564 18802 raft_consensus.cc:374] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:30.604676 18802 raft_consensus.cc:729] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213b0d771a0641f7829173e8a50df70c, State: Initialized, Role: FOLLOWER
I20260811 07:07:30.605484 18802 consensus_queue.cc:260] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } }
I20260811 07:07:30.606825 18774 heartbeater.cc:503] Master 127.30.73.126:42907 was elected leader, sending a full tablet report...
I20260811 07:07:30.607774 18802 ts_tablet_manager.cc:1428] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
I20260811 07:07:30.607762 18801 raft_consensus.cc:348] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } }
I20260811 07:07:30.608345 18801 raft_consensus.cc:374] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:30.608485 18801 raft_consensus.cc:729] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a4c1ea335f64037ba66af2302675563, State: Initialized, Role: FOLLOWER
I20260811 07:07:30.609097 18801 consensus_queue.cc:260] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } }
I20260811 07:07:30.611135 18801 ts_tablet_manager.cc:1428] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: Time spent starting tablet: real 0.017s user 0.013s sys 0.001s
I20260811 07:07:30.634811 18810 raft_consensus.cc:482] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:30.635289 18810 raft_consensus.cc:504] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } }
I20260811 07:07:30.638175 18810 leader_election.cc:288] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 213b0d771a0641f7829173e8a50df70c (127.30.73.67:43961), a71aba5b89d74670bcac396b9b405a7c (127.30.73.66:39819)
I20260811 07:07:30.649415 18799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.638858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:44589 (local address 127.30.73.66:39819)
0811 07:07:30.639165 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.639173 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.640184 (+ 1011us) server_negotiation.cc:407] Connection header received
0811 07:07:30.640466 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.640472 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.640562 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.640677 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:30.641706 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.643133 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.646663 (+ 3530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.648057 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.648233 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.648326 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.648933 (+ 607us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.649107 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 07:07:30.649415 18791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.638997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:51345 (local address 127.30.73.67:43961)
0811 07:07:30.639280 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.639290 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.640201 (+ 911us) server_negotiation.cc:407] Connection header received
0811 07:07:30.640439 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.640446 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.640556 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.640677 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:30.641706 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.643129 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.646649 (+ 3520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.648045 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.648237 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.648326 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.648932 (+ 606us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.649090 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 07:07:30.649688 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.638813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:43961 (local address 127.30.73.65:51345)
0811 07:07:30.640054 (+ 1241us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:30.640074 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:30.640234 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:30.640716 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:30.640722 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:30.640770 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:30.641490 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.641509 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.643357 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.643363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.646380 (+ 3017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.646400 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.648393 (+ 1993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.648398 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.648678 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.648763 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 07:07:30.648874 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:07:30.649077 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1110,"mutex_wait_us":302,"spinlock_wait_cycles":55424,"thread_start_us":567,"threads_started":1}
I20260811 07:07:30.649848 18812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.638576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39819 (local address 127.30.73.65:44589)
0811 07:07:30.639979 (+ 1403us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:30.640013 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:30.640231 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:30.640716 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:30.640722 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:30.640777 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:30.641452 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.641475 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.643357 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.643363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.646380 (+ 3017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:30.646400 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.648367 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.648380 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:30.648671 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.648760 (+ 89us) client_negotiation.cc:769] Sending connection context
0811 07:07:30.648874 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 07:07:30.649077 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1224,"mutex_wait_us":341,"spinlock_wait_cycles":15104,"thread_start_us":961,"threads_started":1}
I20260811 07:07:30.651288 18722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ffaca27a6f45f28d29ab04a2660e1b" candidate_uuid: "7a4c1ea335f64037ba66af2302675563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213b0d771a0641f7829173e8a50df70c" is_pre_election: true
I20260811 07:07:30.651340 18559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ffaca27a6f45f28d29ab04a2660e1b" candidate_uuid: "7a4c1ea335f64037ba66af2302675563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a71aba5b89d74670bcac396b9b405a7c" is_pre_election: true
I20260811 07:07:30.652089 18559 raft_consensus.cc:2454] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a4c1ea335f64037ba66af2302675563 in term 0.
I20260811 07:07:30.652091 18722 raft_consensus.cc:2454] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a4c1ea335f64037ba66af2302675563 in term 0.
I20260811 07:07:30.653036 18324 leader_election.cc:302] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 213b0d771a0641f7829173e8a50df70c, 7a4c1ea335f64037ba66af2302675563, a71aba5b89d74670bcac396b9b405a7c; no voters:
I20260811 07:07:30.653620 18810 raft_consensus.cc:2781] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:07:30.653863 18810 raft_consensus.cc:482] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:07:30.654008 18810 raft_consensus.cc:3037] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:30.656787 18810 raft_consensus.cc:504] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } }
I20260811 07:07:30.657511 18810 leader_election.cc:288] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [CANDIDATE]: Term 1 election: Requested vote from peers 213b0d771a0641f7829173e8a50df70c (127.30.73.67:43961), a71aba5b89d74670bcac396b9b405a7c (127.30.73.66:39819)
I20260811 07:07:30.658259 18559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ffaca27a6f45f28d29ab04a2660e1b" candidate_uuid: "7a4c1ea335f64037ba66af2302675563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a71aba5b89d74670bcac396b9b405a7c"
I20260811 07:07:30.658259 18722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ffaca27a6f45f28d29ab04a2660e1b" candidate_uuid: "7a4c1ea335f64037ba66af2302675563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213b0d771a0641f7829173e8a50df70c"
I20260811 07:07:30.658572 18722 raft_consensus.cc:3037] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:30.658529 18559 raft_consensus.cc:3037] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:30.662503 18559 raft_consensus.cc:2454] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a4c1ea335f64037ba66af2302675563 in term 1.
I20260811 07:07:30.662503 18722 raft_consensus.cc:2454] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a4c1ea335f64037ba66af2302675563 in term 1.
I20260811 07:07:30.663065 18324 leader_election.cc:302] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 213b0d771a0641f7829173e8a50df70c, 7a4c1ea335f64037ba66af2302675563, a71aba5b89d74670bcac396b9b405a7c; no voters:
I20260811 07:07:30.663450 18810 raft_consensus.cc:2781] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:30.664031 18810 raft_consensus.cc:686] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 1 LEADER]: Becoming Leader. State: Replica: 7a4c1ea335f64037ba66af2302675563, State: Running, Role: LEADER
I20260811 07:07:30.664649 18810 consensus_queue.cc:237] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } }
I20260811 07:07:30.670958 18226 catalog_manager.cc:5495] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a4c1ea335f64037ba66af2302675563 (127.30.73.65). New cstate: current_term: 1 leader_uuid: "7a4c1ea335f64037ba66af2302675563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a4c1ea335f64037ba66af2302675563" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 } health_report { overall_health: UNKNOWN } } }
W20260811 07:07:30.684325 18451 tablet.cc:2369] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:07:30.696789 18775 tablet.cc:2369] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:07:30.708062 18793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.701210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40928 (local address 127.30.73.65:45637)
0811 07:07:30.701508 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.701517 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.701641 (+ 124us) server_negotiation.cc:407] Connection header received
0811 07:07:30.701986 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.701991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.702095 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.702276 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:07:30.702707 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.703601 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.705352 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.705899 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.706056 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.706672 (+ 616us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:07:30.707356 (+ 684us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:07:30.707551 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.707609 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.707713 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260811 07:07:30.718729 18722 raft_consensus.cc:1261] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [term 1 FOLLOWER]: Refusing update from remote peer 7a4c1ea335f64037ba66af2302675563: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:30.718729 18559 raft_consensus.cc:1261] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [term 1 FOLLOWER]: Refusing update from remote peer 7a4c1ea335f64037ba66af2302675563: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:30.720292 18813 consensus_queue.cc:1035] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213b0d771a0641f7829173e8a50df70c" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:30.720834 18810 consensus_queue.cc:1035] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a71aba5b89d74670bcac396b9b405a7c" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:30.756240 18227 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:30.756847 18227 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:30.762481 18227 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c6ce2d47a12146c0980e7cd9a7da4a88: Sending DeleteTablet for 3 replicas of tablet 25ffaca27a6f45f28d29ab04a2660e1b
I20260811 07:07:30.764425 18701 tablet_service.cc:1514] Processing DeleteTablet for tablet 25ffaca27a6f45f28d29ab04a2660e1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:30 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:50508
I20260811 07:07:30.764498 18534 tablet_service.cc:1514] Processing DeleteTablet for tablet 25ffaca27a6f45f28d29ab04a2660e1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:30 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:50926
I20260811 07:07:30.765369 18372 tablet_service.cc:1514] Processing DeleteTablet for tablet 25ffaca27a6f45f28d29ab04a2660e1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:30 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:40918
I20260811 07:07:30.776760 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 18300
I20260811 07:07:30.786849 18832 tablet_replica.cc:330] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: stopping tablet replica
I20260811 07:07:30.787762 18830 tablet_replica.cc:330] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: stopping tablet replica
I20260811 07:07:30.788167 18831 tablet_replica.cc:330] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: stopping tablet replica
I20260811 07:07:30.788520 18832 raft_consensus.cc:2229] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:07:30.788672 18831 raft_consensus.cc:2229] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:30.789438 18831 raft_consensus.cc:2258] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:30.789438 18832 raft_consensus.cc:2258] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:30.790428 18830 raft_consensus.cc:2229] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:30.791203 18830 raft_consensus.cc:2258] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:30.793224 18831 ts_tablet_manager.cc:1905] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:30.793232 18832 ts_tablet_manager.cc:1905] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:30.795904 18830 ts_tablet_manager.cc:1905] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:30.803751 18831 ts_tablet_manager.cc:1918] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:30.803742 18832 ts_tablet_manager.cc:1918] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:30.804025 18832 log.cc:1196] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/25ffaca27a6f45f28d29ab04a2660e1b
I20260811 07:07:30.804450 18831 log.cc:1196] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/25ffaca27a6f45f28d29ab04a2660e1b
I20260811 07:07:30.805326 18832 ts_tablet_manager.cc:1939] T 25ffaca27a6f45f28d29ab04a2660e1b P 7a4c1ea335f64037ba66af2302675563: Deleting consensus metadata
I20260811 07:07:30.805676 18831 ts_tablet_manager.cc:1939] T 25ffaca27a6f45f28d29ab04a2660e1b P 213b0d771a0641f7829173e8a50df70c: Deleting consensus metadata
I20260811 07:07:30.808573 18212 catalog_manager.cc:4841] TS 7a4c1ea335f64037ba66af2302675563 (127.30.73.65:45637): tablet 25ffaca27a6f45f28d29ab04a2660e1b (table test-table [id=c2f72dd7ad6d47e2b4e1491b08c9458e]) successfully deleted
I20260811 07:07:30.809067 18212 catalog_manager.cc:4841] TS 213b0d771a0641f7829173e8a50df70c (127.30.73.67:43961): tablet 25ffaca27a6f45f28d29ab04a2660e1b (table test-table [id=c2f72dd7ad6d47e2b4e1491b08c9458e]) successfully deleted
Aug 11 07:07:30 dist-test-slave-69rg krb5kdc[18177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:07:30.814000 18830 ts_tablet_manager.cc:1918] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:30.814256 18830 log.cc:1196] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/25ffaca27a6f45f28d29ab04a2660e1b
I20260811 07:07:30.814934 18830 ts_tablet_manager.cc:1939] T 25ffaca27a6f45f28d29ab04a2660e1b P a71aba5b89d74670bcac396b9b405a7c: Deleting consensus metadata
I20260811 07:07:30.817700 18210 catalog_manager.cc:4841] TS a71aba5b89d74670bcac396b9b405a7c (127.30.73.66:39819): tablet 25ffaca27a6f45f28d29ab04a2660e1b (table test-table [id=c2f72dd7ad6d47e2b4e1491b08c9458e]) successfully deleted
I20260811 07:07:30.823253 18793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.779776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40936 (local address 127.30.73.65:45637)
0811 07:07:30.780021 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.780029 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.790699 (+ 10670us) server_negotiation.cc:407] Connection header received
0811 07:07:30.791003 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.791011 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.791124 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.791279 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:30.796994 (+ 5715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.798877 (+ 1883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.804181 (+ 5304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.805306 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.805452 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.815178 (+ 9726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:30.815200 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:30.815221 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:30.815280 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:30.819507 (+ 4227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:30.820482 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:30.820494 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:30.820496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:30.820706 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:30.821190 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:30.821194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:30.821196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:30.821671 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:30.822070 (+ 399us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.822495 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.822799 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:07:30.824167 18445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:30.942545 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 18300
I20260811 07:07:30.974241 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 18460
Aug 11 07:07:30 dist-test-slave-69rg krb5kdc[18177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:07:30.996536 18799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:30.975379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50938 (local address 127.30.73.66:39819)
0811 07:07:30.975649 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:30.975655 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:30.975678 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:07:30.975763 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:30.975769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:30.975876 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:30.975990 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:30.977608 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.978887 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.980617 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:30.981079 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:30.981208 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:30.987943 (+ 6735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:30.987971 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:30.987992 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:30.988055 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:30.992308 (+ 4253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:30.993496 (+ 1188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:30.993505 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:30.993507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:30.993678 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:30.994541 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:30.994545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:30.994547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:30.995062 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:30.995370 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:30.995959 (+ 589us) server_negotiation.cc:299] Negotiation successful
0811 07:07:30.996201 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 07:07:30.997741 18607 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:31.108561 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 18460
I20260811 07:07:31.137333 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 18620
Aug 11 07:07:31 dist-test-slave-69rg krb5kdc[18177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:07:31.165138 18791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:31.138392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50512 (local address 127.30.73.67:43961)
0811 07:07:31.138605 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:31.138610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:31.138632 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:07:31.138713 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:31.138717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:31.138798 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:31.138901 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:31.140884 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:31.142599 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:31.144613 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:31.145135 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:31.145416 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:31.158287 (+ 12871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:31.158313 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:31.158332 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:31.158391 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:31.161583 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:31.162604 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:31.162613 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:31.162616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:31.162917 (+ 301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:31.163388 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:31.163392 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:31.163394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:31.163829 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:31.164236 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:31.164612 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 07:07:31.164827 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:07:31.166067 18769 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:31.267448 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 18620
I20260811 07:07:31.290736 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 18191
I20260811 07:07:31.292039 18262 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:31.407217 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 18191
2026-08-11T07:07:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5000 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T07:07:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:31Z Disabled control of system clock
I20260811 07:07:31.510217 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35967
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:44651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:35967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:07:31.892470 18843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:31.892781 18843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:31.892936 18843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:31.900427 18843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:31.900555 18843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:31.900596 18843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:31.900732 18843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:31.900868 18843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:31.910585 18843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:35967
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:31.912168 18843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:31.914166 18843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:31.926713 18852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:31.926796 18848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:31.926772 18849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:31.928241 18843 server_base.cc:1034] running on GCE node
I20260811 07:07:31.929117 18843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:31.930764 18843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:31.932024 18843 hybrid_clock.cc:648] HybridClock initialized: now 1786432051931983 us; error 56 us; skew 500 ppm
I20260811 07:07:31.932433 18843 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:31.934914 18843 webserver.cc:460] Webserver started at http://127.30.73.126:34119/ using document root <none> and password file <none>
I20260811 07:07:31.935707 18843 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:31.935853 18843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:31.936195 18843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:31.939453 18843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "5a07970aa01843aab5297deedb00080e"
format_stamp: "Formatted at 2026-08-11 07:07:31 on dist-test-slave-69rg"
server_key: "edd92ea506f8067605596964e8cc35c4"
server_key_iv: "52ca21fc0de24e8d8bf1c8c259530671"
server_key_version: "encryptionkey@0"
I20260811 07:07:31.940696 18843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "5a07970aa01843aab5297deedb00080e"
format_stamp: "Formatted at 2026-08-11 07:07:31 on dist-test-slave-69rg"
server_key: "edd92ea506f8067605596964e8cc35c4"
server_key_iv: "52ca21fc0de24e8d8bf1c8c259530671"
server_key_version: "encryptionkey@0"
I20260811 07:07:31.946540 18843 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:07:31.950388 18859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:31.952193 18843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:07:31.952445 18843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "5a07970aa01843aab5297deedb00080e"
format_stamp: "Formatted at 2026-08-11 07:07:31 on dist-test-slave-69rg"
server_key: "edd92ea506f8067605596964e8cc35c4"
server_key_iv: "52ca21fc0de24e8d8bf1c8c259530671"
server_key_version: "encryptionkey@0"
I20260811 07:07:31.952811 18843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:31.987341 18843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:31.988271 18843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:31.988592 18843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:32.009171 18843 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:35967
I20260811 07:07:32.009207 18912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:35967 every 8 connection(s)
I20260811 07:07:32.010828 18843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:32.013789 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 18843
I20260811 07:07:32.014019 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:07:32.014607 31013 external_mini_cluster.cc:1428] Setting key c7f3048f2cd22c5c2f73434ec2e61fee
I20260811 07:07:32.015810 18913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:32.029542 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:32.016652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40138 (local address 127.30.73.126:35967)
0811 07:07:32.017738 (+ 1086us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:32.017752 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:32.017806 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:07:32.019473 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:32.019494 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:32.019996 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:32.020357 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:32.020991 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:32.022484 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:32.024640 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:32.025397 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:32.025553 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:32.027007 (+ 1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:32.027015 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:32.027030 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:32.027660 (+ 630us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:32.027739 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:32.027787 (+ 48us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:32.027894 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:32.028147 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 07:07:32.028544 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":415,"threads_started":1}
I20260811 07:07:32.030794 18913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e: Bootstrap starting.
I20260811 07:07:32.034327 18913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:32.035511 18913 log.cc:824] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:32.038395 18913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e: No bootstrap required, opened a new log
I20260811 07:07:32.045733 18913 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a07970aa01843aab5297deedb00080e" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35967 } }
I20260811 07:07:32.046178 18913 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:32.046286 18913 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a07970aa01843aab5297deedb00080e, State: Initialized, Role: FOLLOWER
I20260811 07:07:32.047091 18913 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a07970aa01843aab5297deedb00080e" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35967 } }
I20260811 07:07:32.047361 18913 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:32.047470 18920 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:32.047744 18920 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a07970aa01843aab5297deedb00080e" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35967 } }
I20260811 07:07:32.048434 18913 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:32.048619 18913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:32.048485 18920 leader_election.cc:302] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a07970aa01843aab5297deedb00080e; no voters:
I20260811 07:07:32.049428 18920 leader_election.cc:288] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260811 07:07:32.051301 18913 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a07970aa01843aab5297deedb00080e" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35967 } }
I20260811 07:07:32.051723 18921 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260811 07:07:32.052768 18913 leader_election.cc:302] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a07970aa01843aab5297deedb00080e; no voters:
I20260811 07:07:32.053056 18913 leader_election.cc:288] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:07:32.053102 18920 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:32.053647 18920 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [term 1 LEADER]: Becoming Leader. State: Replica: 5a07970aa01843aab5297deedb00080e, State: Running, Role: LEADER
I20260811 07:07:32.054179 18920 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a07970aa01843aab5297deedb00080e" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35967 } }
I20260811 07:07:32.054750 18913 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:32.056360 18922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a07970aa01843aab5297deedb00080e. Latest consensus state: current_term: 1 leader_uuid: "5a07970aa01843aab5297deedb00080e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a07970aa01843aab5297deedb00080e" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35967 } } }
I20260811 07:07:32.056953 18922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:32.057574 18921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a07970aa01843aab5297deedb00080e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a07970aa01843aab5297deedb00080e" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35967 } } }
I20260811 07:07:32.058035 18921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:32.076866 18929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:32.083328 18929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:32.093494 18929 catalog_manager.cc:1347] Generated new cluster ID: cb53c01b018346dda5ba96ebdf981ce7
I20260811 07:07:32.093639 18929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:32.114611 18929 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:07:32.116292 18929 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:32.128363 18929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e: Generated new TSK 0
I20260811 07:07:32.129424 18929 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:07:32.147286 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35967
--builtin_ntp_servers=127.30.73.84:44651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:07:32.540059 18944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:32.540390 18944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:32.540479 18944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:32.548058 18944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:32.548167 18944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:32.548280 18944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:07:32.557984 18944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:32.559401 18944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:32.561208 18944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:32.574903 18952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:32.574927 18953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:32.575053 18955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:32.576359 18944 server_base.cc:1034] running on GCE node
I20260811 07:07:32.577008 18944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:32.578127 18944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:32.579375 18944 hybrid_clock.cc:648] HybridClock initialized: now 1786432052579325 us; error 49 us; skew 500 ppm
I20260811 07:07:32.579717 18944 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:32.582239 18944 webserver.cc:460] Webserver started at http://127.30.73.65:42851/ using document root <none> and password file <none>
I20260811 07:07:32.582984 18944 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:32.583125 18944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:32.583463 18944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:32.586620 18944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "e597076e95f24332be8c2fd7a41f0db8"
format_stamp: "Formatted at 2026-08-11 07:07:32 on dist-test-slave-69rg"
server_key: "c925aecd661faaea23744a69839fa336"
server_key_iv: "5fc02f231174c65eb9407ccca36af76f"
server_key_version: "encryptionkey@0"
I20260811 07:07:32.587455 18944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "e597076e95f24332be8c2fd7a41f0db8"
format_stamp: "Formatted at 2026-08-11 07:07:32 on dist-test-slave-69rg"
server_key: "c925aecd661faaea23744a69839fa336"
server_key_iv: "5fc02f231174c65eb9407ccca36af76f"
server_key_version: "encryptionkey@0"
I20260811 07:07:32.592679 18944 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 07:07:32.596532 18963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:32.598146 18944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:07:32.598403 18944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "e597076e95f24332be8c2fd7a41f0db8"
format_stamp: "Formatted at 2026-08-11 07:07:32 on dist-test-slave-69rg"
server_key: "c925aecd661faaea23744a69839fa336"
server_key_iv: "5fc02f231174c65eb9407ccca36af76f"
server_key_version: "encryptionkey@0"
I20260811 07:07:32.598665 18944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:32.616487 18944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:32.617519 18944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:32.617933 18944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:32.619148 18944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:32.620860 18944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:32.621004 18944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:32.621165 18944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:32.621266 18944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:32.659739 18944 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:38027
I20260811 07:07:32.659791 19088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:38027 every 8 connection(s)
I20260811 07:07:32.661164 18944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:07:32.667554 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 18944
I20260811 07:07:32.667774 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:07:32.668402 31013 external_mini_cluster.cc:1428] Setting key e30f84e74c3580c0095e6043a9b5891c
I20260811 07:07:32.671741 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35967
--builtin_ntp_servers=127.30.73.84:44651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:07:32.676318 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:32.664054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:43841 (local address 127.30.73.126:35967)
0811 07:07:32.664588 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:32.664593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:32.665687 (+ 1094us) server_negotiation.cc:407] Connection header received
0811 07:07:32.667691 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:32.667697 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:32.667811 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:32.667950 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:32.669430 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:32.670503 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:32.672520 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:32.673303 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:32.673467 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:32.675179 (+ 1712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:32.675189 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:32.675196 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:32.675226 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:32.675284 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:32.675304 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:32.675422 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:32.675735 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 07:07:32.675861 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":301,"threads_started":1}
I20260811 07:07:32.677244 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:32.664563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35967 (local address 127.30.73.65:43841)
0811 07:07:32.665508 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:32.665555 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:32.667391 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:32.668271 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:32.668283 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:32.668403 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:32.669236 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:32.669267 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:32.670744 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:32.670750 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:32.672316 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:32.672330 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:32.673571 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:32.673577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:32.673889 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:32.674751 (+ 862us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:07:32.674755 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:32.674803 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:07:32.674897 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:32.675452 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:32.675463 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:32.675470 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:07:32.675685 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 07:07:32.676028 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":288,"threads_started":1}
I20260811 07:07:32.679109 19089 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35967
I20260811 07:07:32.679637 19089 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:32.680518 19089 heartbeater.cc:511] Master 127.30.73.126:35967 requested a full tablet report, sending...
I20260811 07:07:32.683012 18876 ts_manager.cc:194] Registered new tserver with Master: e597076e95f24332be8c2fd7a41f0db8 (127.30.73.65:38027)
I20260811 07:07:32.684835 18876 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.65:43841
W20260811 07:07:33.034384 19095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:33.034687 19095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:33.034783 19095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:33.042425 19095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:33.042558 19095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:33.042671 19095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:07:33.052620 19095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:33.054081 19095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:33.056042 19095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:33.070312 19102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:33.070312 19101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:33.070314 19105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:33.070946 19095 server_base.cc:1034] running on GCE node
I20260811 07:07:33.071607 19095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:33.072585 19095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:33.073882 19095 hybrid_clock.cc:648] HybridClock initialized: now 1786432053073763 us; error 53 us; skew 500 ppm
I20260811 07:07:33.074249 19095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:33.076985 19095 webserver.cc:460] Webserver started at http://127.30.73.66:45405/ using document root <none> and password file <none>
I20260811 07:07:33.077775 19095 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:33.077980 19095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:33.078354 19095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:33.081501 19095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2"
format_stamp: "Formatted at 2026-08-11 07:07:33 on dist-test-slave-69rg"
server_key: "0f83b4447f908f863887f3964fd284dc"
server_key_iv: "4f6c773fb4474428c1c73584c4cbc4d3"
server_key_version: "encryptionkey@0"
I20260811 07:07:33.082435 19095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2"
format_stamp: "Formatted at 2026-08-11 07:07:33 on dist-test-slave-69rg"
server_key: "0f83b4447f908f863887f3964fd284dc"
server_key_iv: "4f6c773fb4474428c1c73584c4cbc4d3"
server_key_version: "encryptionkey@0"
I20260811 07:07:33.088158 19095 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 07:07:33.091802 19111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:33.093149 19095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:07:33.093349 19095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2"
format_stamp: "Formatted at 2026-08-11 07:07:33 on dist-test-slave-69rg"
server_key: "0f83b4447f908f863887f3964fd284dc"
server_key_iv: "4f6c773fb4474428c1c73584c4cbc4d3"
server_key_version: "encryptionkey@0"
I20260811 07:07:33.093581 19095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:33.110737 19095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:33.111707 19095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:33.112061 19095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:33.113140 19095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:33.114850 19095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:33.114987 19095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:33.115131 19095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:33.115226 19095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:33.150012 19095 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:33905
I20260811 07:07:33.150050 19246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:33905 every 8 connection(s)
I20260811 07:07:33.151448 19095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:07:33.158836 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 19095
I20260811 07:07:33.159087 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:07:33.159605 31013 external_mini_cluster.cc:1428] Setting key 25a99e6e55baa5ac12add9bc65f8aef6
I20260811 07:07:33.162849 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35967
--builtin_ntp_servers=127.30.73.84:44651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:07:33.166184 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.154466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:50527 (local address 127.30.73.126:35967)
0811 07:07:33.154707 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.154713 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.156284 (+ 1571us) server_negotiation.cc:407] Connection header received
0811 07:07:33.158440 (+ 2156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.158448 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.158563 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.158704 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:33.160093 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.161173 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.163201 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.163619 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.163760 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.165280 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:33.165286 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:33.165289 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:33.165309 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:33.165342 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:33.165354 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:33.165458 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.165697 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.165807 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:07:33.167383 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.155054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35967 (local address 127.30.73.66:50527)
0811 07:07:33.156098 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:33.156152 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:33.158021 (+ 1869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:33.158919 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:33.158927 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:33.159045 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:33.159784 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.159803 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.161353 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.161359 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.162941 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.162954 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.163869 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.163877 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.164114 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.164922 (+ 808us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:07:33.164925 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:33.164967 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:07:33.165048 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:33.165458 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:33.165471 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:33.165482 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:07:33.165685 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 07:07:33.166191 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":374,"threads_started":1}
I20260811 07:07:33.169633 19247 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35967
I20260811 07:07:33.170941 19247 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:33.172067 19247 heartbeater.cc:511] Master 127.30.73.126:35967 requested a full tablet report, sending...
I20260811 07:07:33.174245 18876 ts_manager.cc:194] Registered new tserver with Master: dfdc34d8fb7d4457944bd7fa4df4e2a2 (127.30.73.66:33905)
I20260811 07:07:33.175148 18876 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.66:50527
W20260811 07:07:33.541584 19250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:33.542001 19250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:33.542100 19250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:33.549506 19250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:33.549607 19250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:33.549714 19250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:07:33.559425 19250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:35967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:33.560716 19250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:33.562677 19250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:33.576613 19255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:33.576520 19258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:33.576591 19256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:33.579613 19250 server_base.cc:1034] running on GCE node
I20260811 07:07:33.580283 19250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:33.581347 19250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:33.582573 19250 hybrid_clock.cc:648] HybridClock initialized: now 1786432053582513 us; error 53 us; skew 500 ppm
I20260811 07:07:33.582938 19250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:33.585425 19250 webserver.cc:460] Webserver started at http://127.30.73.67:46411/ using document root <none> and password file <none>
I20260811 07:07:33.586262 19250 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:33.586386 19250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:33.586738 19250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:33.589931 19250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d"
format_stamp: "Formatted at 2026-08-11 07:07:33 on dist-test-slave-69rg"
server_key: "50ed78d050a39bf4fbc257aa9ff6a6d9"
server_key_iv: "d5f0d8503c5b85e544d951e1c0d55cbc"
server_key_version: "encryptionkey@0"
I20260811 07:07:33.590794 19250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d"
format_stamp: "Formatted at 2026-08-11 07:07:33 on dist-test-slave-69rg"
server_key: "50ed78d050a39bf4fbc257aa9ff6a6d9"
server_key_iv: "d5f0d8503c5b85e544d951e1c0d55cbc"
server_key_version: "encryptionkey@0"
I20260811 07:07:33.596326 19250 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 07:07:33.600417 19266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:33.601995 19250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:07:33.602180 19250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d"
format_stamp: "Formatted at 2026-08-11 07:07:33 on dist-test-slave-69rg"
server_key: "50ed78d050a39bf4fbc257aa9ff6a6d9"
server_key_iv: "d5f0d8503c5b85e544d951e1c0d55cbc"
server_key_version: "encryptionkey@0"
I20260811 07:07:33.602416 19250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:33.623590 19250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:33.624469 19250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:33.624754 19250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:33.625765 19250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:33.627453 19250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:33.627547 19250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:33.627630 19250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:33.627696 19250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:33.663257 19250 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:37429
I20260811 07:07:33.663317 19405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:37429 every 8 connection(s)
I20260811 07:07:33.664566 19250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:07:33.671738 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 19250
I20260811 07:07:33.671931 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:07:33.672441 31013 external_mini_cluster.cc:1428] Setting key 7ac752fa7a89b1ded1e87d80b5dc8cf3
I20260811 07:07:33.678356 19408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.667251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:45551 (local address 127.30.73.126:35967)
0811 07:07:33.667746 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.667751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.669160 (+ 1409us) server_negotiation.cc:407] Connection header received
0811 07:07:33.671172 (+ 2012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.671180 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.671284 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.671429 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:33.672666 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.673548 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.675276 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.675707 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.675845 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.677334 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:33.677343 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:33.677353 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:33.677372 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:33.677440 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:33.677453 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:33.677559 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.677809 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.677939 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":258,"threads_started":1}
I20260811 07:07:33.679406 19409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.667866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:35967 (local address 127.30.73.67:45551)
0811 07:07:33.668963 (+ 1097us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:33.668999 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:33.670888 (+ 1889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:33.671670 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:33.671678 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:33.671763 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:33.672453 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.672471 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.673735 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.673740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.675122 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.675135 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.675958 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.675966 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.676203 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.676967 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:07:33.676972 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:33.677013 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:07:33.677102 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:33.677562 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:33.677577 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:33.677587 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:07:33.677799 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 07:07:33.678292 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":292,"threads_started":1}
I20260811 07:07:33.680824 19406 heartbeater.cc:347] Connected to a master server at 127.30.73.126:35967
I20260811 07:07:33.681155 19406 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:33.682013 19406 heartbeater.cc:511] Master 127.30.73.126:35967 requested a full tablet report, sending...
I20260811 07:07:33.683521 18876 ts_manager.cc:194] Registered new tserver with Master: a5dd79b5a7a34c5e8d8b6f5c07dc5a4d (127.30.73.67:37429)
I20260811 07:07:33.684391 18876 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.67:45551
I20260811 07:07:33.687860 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:07:33.688369 19089 heartbeater.cc:503] Master 127.30.73.126:35967 was elected leader, sending a full tablet report...
I20260811 07:07:33.698978 19408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.692643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40142 (local address 127.30.73.126:35967)
0811 07:07:33.692821 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.692826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.693329 (+ 503us) server_negotiation.cc:407] Connection header received
0811 07:07:33.693471 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.693474 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.693536 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.693621 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:33.694230 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.694947 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.696540 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.696959 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.697066 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.698299 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:33.698303 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:33.698307 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:33.698334 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:33.698370 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:33.698381 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:33.698460 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.698644 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.698724 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:07:33.703343 18876 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:07:33.710762 18876 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:07:33.738337 19428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.728515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51062 (local address 127.30.73.67:37429)
0811 07:07:33.729558 (+ 1043us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.729572 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.729620 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:07:33.729756 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.729766 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.730520 (+ 754us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.731408 (+ 888us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:33.731733 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.732847 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.735777 (+ 2930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.737038 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.737211 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.737542 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.737696 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.737919 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":788,"thread_start_us":573,"threads_started":1}
I20260811 07:07:33.738368 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.727743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:37429 (local address 127.0.0.1:51062)
0811 07:07:33.728454 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:33.728478 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:33.728622 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:33.730742 (+ 2120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:33.730747 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:33.730780 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:33.731279 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.731297 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.733001 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.733009 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.735512 (+ 2503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.735530 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.737251 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.737258 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.737459 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.737515 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 07:07:33.737653 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 07:07:33.737919 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"mutex_wait_us":68,"thread_start_us":1186,"threads_started":1}
I20260811 07:07:33.739161 19426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.724184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:33905 (local address 127.0.0.1:39800)
0811 07:07:33.726757 (+ 2573us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:33.726783 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:33.726942 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:33.730606 (+ 3664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:33.730615 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:33.730651 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:33.731732 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.731747 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.733948 (+ 2201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.733953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.736315 (+ 2362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.736332 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.738377 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.738383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.738572 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.738602 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:07:33.738671 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:07:33.738817 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2379,"mutex_wait_us":330,"thread_start_us":3124,"threads_started":1}
I20260811 07:07:33.739120 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.723723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38027 (local address 127.0.0.1:43116)
0811 07:07:33.724742 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:33.724807 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:33.725051 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:33.730864 (+ 5813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:33.730868 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:33.730894 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:33.731535 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.731555 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.733620 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.733626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.735956 (+ 2330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.735967 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.737884 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.737893 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.738092 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.738125 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:07:33.738203 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 07:07:33.738374 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":1,"thread_start_us":555,"threads_started":1}
I20260811 07:07:33.740388 19425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.724671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39800 (local address 127.30.73.66:33905)
0811 07:07:33.729853 (+ 5182us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.729864 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.729901 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:07:33.730019 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.730027 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.730315 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.731095 (+ 780us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:33.731935 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.733444 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.736540 (+ 3096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.738141 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.739470 (+ 1329us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.739741 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.739827 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.740007 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4988,"thread_start_us":4856,"threads_started":1}
I20260811 07:07:33.740641 19424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.723961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43116 (local address 127.30.73.65:38027)
0811 07:07:33.730217 (+ 6256us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.730225 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.730252 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:07:33.730349 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.730359 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.730618 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.731102 (+ 484us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:33.731735 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.733444 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.736157 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.737571 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.739728 (+ 2157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.739986 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.740071 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.740249 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6069,"thread_start_us":5923,"threads_started":1}
I20260811 07:07:33.743520 19018 tablet_service.cc:1467] Processing CreateTablet for tablet b040ff247cfe4a78bf16fd4e054934ff (DEFAULT_TABLE table=test-table [id=d7c2089c75fa44edbb9ae1d757a5cd66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:33.743939 19169 tablet_service.cc:1467] Processing CreateTablet for tablet b040ff247cfe4a78bf16fd4e054934ff (DEFAULT_TABLE table=test-table [id=d7c2089c75fa44edbb9ae1d757a5cd66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:33.743400 19328 tablet_service.cc:1467] Processing CreateTablet for tablet b040ff247cfe4a78bf16fd4e054934ff (DEFAULT_TABLE table=test-table [id=d7c2089c75fa44edbb9ae1d757a5cd66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:33.745278 19018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b040ff247cfe4a78bf16fd4e054934ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:33.745514 19169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b040ff247cfe4a78bf16fd4e054934ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:33.745744 19328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b040ff247cfe4a78bf16fd4e054934ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:33.759008 19429 tablet_bootstrap.cc:492] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: Bootstrap starting.
I20260811 07:07:33.760767 19431 tablet_bootstrap.cc:492] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8: Bootstrap starting.
I20260811 07:07:33.761891 19430 tablet_bootstrap.cc:492] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: Bootstrap starting.
I20260811 07:07:33.763322 19429 tablet_bootstrap.cc:654] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:33.764420 19431 tablet_bootstrap.cc:654] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:33.764750 19429 log.cc:824] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:33.765578 19431 log.cc:824] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:33.765902 19430 tablet_bootstrap.cc:654] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:33.767309 19430 log.cc:824] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:33.768319 19429 tablet_bootstrap.cc:492] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: No bootstrap required, opened a new log
I20260811 07:07:33.768611 19429 ts_tablet_manager.cc:1397] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260811 07:07:33.769620 19431 tablet_bootstrap.cc:492] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8: No bootstrap required, opened a new log
I20260811 07:07:33.769984 19431 ts_tablet_manager.cc:1397] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 07:07:33.777266 19430 tablet_bootstrap.cc:492] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: No bootstrap required, opened a new log
I20260811 07:07:33.777609 19430 ts_tablet_manager.cc:1397] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.010s
I20260811 07:07:33.777805 19429 raft_consensus.cc:348] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } }
I20260811 07:07:33.778422 19429 raft_consensus.cc:374] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:33.778544 19429 raft_consensus.cc:729] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfdc34d8fb7d4457944bd7fa4df4e2a2, State: Initialized, Role: FOLLOWER
I20260811 07:07:33.779229 19429 consensus_queue.cc:260] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } }
I20260811 07:07:33.780529 19247 heartbeater.cc:503] Master 127.30.73.126:35967 was elected leader, sending a full tablet report...
I20260811 07:07:33.781920 19429 ts_tablet_manager.cc:1428] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: Time spent starting tablet: real 0.013s user 0.006s sys 0.009s
I20260811 07:07:33.783071 19431 raft_consensus.cc:348] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } }
I20260811 07:07:33.783572 19431 raft_consensus.cc:374] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:33.783687 19431 raft_consensus.cc:729] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e597076e95f24332be8c2fd7a41f0db8, State: Initialized, Role: FOLLOWER
I20260811 07:07:33.784403 19431 consensus_queue.cc:260] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } }
I20260811 07:07:33.787029 19431 ts_tablet_manager.cc:1428] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260811 07:07:33.789120 19430 raft_consensus.cc:348] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } }
I20260811 07:07:33.789718 19430 raft_consensus.cc:374] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:33.789880 19430 raft_consensus.cc:729] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dd79b5a7a34c5e8d8b6f5c07dc5a4d, State: Initialized, Role: FOLLOWER
I20260811 07:07:33.790648 19430 consensus_queue.cc:260] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } }
I20260811 07:07:33.792335 19406 heartbeater.cc:503] Master 127.30.73.126:35967 was elected leader, sending a full tablet report...
I20260811 07:07:33.792686 19430 ts_tablet_manager.cc:1428] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
I20260811 07:07:33.832201 19438 raft_consensus.cc:482] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:33.832521 19438 raft_consensus.cc:504] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } }
I20260811 07:07:33.834308 19438 leader_election.cc:288] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dfdc34d8fb7d4457944bd7fa4df4e2a2 (127.30.73.66:33905), a5dd79b5a7a34c5e8d8b6f5c07dc5a4d (127.30.73.67:37429)
I20260811 07:07:33.840974 19425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.834945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:36441 (local address 127.30.73.66:33905)
0811 07:07:33.835183 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.835192 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.835605 (+ 413us) server_negotiation.cc:407] Connection header received
0811 07:07:33.835837 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.835847 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.835965 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.836061 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:33.836706 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.837409 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.839290 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.840043 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.840230 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.840316 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.840565 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.840695 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:07:33.841027 19440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.834766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:33905 (local address 127.30.73.65:36441)
0811 07:07:33.835487 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:33.835503 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:33.835685 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:33.836161 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:33.836167 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:33.836201 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:33.836546 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.836555 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.837546 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.837553 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.839087 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.839100 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.840234 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.840240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.840407 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.840431 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:07:33.840537 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 07:07:33.840667 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":431,"threads_started":1}
I20260811 07:07:33.841710 19428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.835807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:43831 (local address 127.30.73.67:37429)
0811 07:07:33.836062 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.836068 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.836485 (+ 417us) server_negotiation.cc:407] Connection header received
0811 07:07:33.836726 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.836730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.836789 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.836889 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:33.837447 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.838252 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.839945 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.840725 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.840924 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.840994 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.841364 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.841493 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 07:07:33.842383 19441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.835647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:37429 (local address 127.30.73.65:43831)
0811 07:07:33.836371 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:33.836385 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:33.836564 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:33.836911 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:33.836915 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:33.836938 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:33.837271 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.837280 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.838406 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.838414 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.839751 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:33.839763 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.840929 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.840935 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:33.841162 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.841212 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 07:07:33.841935 (+ 723us) client_negotiation.cc:240] Negotiation successful
0811 07:07:33.842076 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":432,"threads_started":1}
I20260811 07:07:33.842303 19191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b040ff247cfe4a78bf16fd4e054934ff" candidate_uuid: "e597076e95f24332be8c2fd7a41f0db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" is_pre_election: true
I20260811 07:07:33.842914 19191 raft_consensus.cc:2454] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e597076e95f24332be8c2fd7a41f0db8 in term 0.
I20260811 07:07:33.843495 19351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b040ff247cfe4a78bf16fd4e054934ff" candidate_uuid: "e597076e95f24332be8c2fd7a41f0db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" is_pre_election: true
I20260811 07:07:33.843715 18966 leader_election.cc:302] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfdc34d8fb7d4457944bd7fa4df4e2a2, e597076e95f24332be8c2fd7a41f0db8; no voters:
I20260811 07:07:33.844045 19351 raft_consensus.cc:2454] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e597076e95f24332be8c2fd7a41f0db8 in term 0.
I20260811 07:07:33.844198 19438 raft_consensus.cc:2781] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:07:33.844359 19438 raft_consensus.cc:482] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:07:33.844473 19438 raft_consensus.cc:3037] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:33.846841 19438 raft_consensus.cc:504] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } }
I20260811 07:07:33.847452 19438 leader_election.cc:288] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [CANDIDATE]: Term 1 election: Requested vote from peers dfdc34d8fb7d4457944bd7fa4df4e2a2 (127.30.73.66:33905), a5dd79b5a7a34c5e8d8b6f5c07dc5a4d (127.30.73.67:37429)
I20260811 07:07:33.847994 19191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b040ff247cfe4a78bf16fd4e054934ff" candidate_uuid: "e597076e95f24332be8c2fd7a41f0db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2"
I20260811 07:07:33.848088 19351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b040ff247cfe4a78bf16fd4e054934ff" candidate_uuid: "e597076e95f24332be8c2fd7a41f0db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d"
I20260811 07:07:33.848212 19191 raft_consensus.cc:3037] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:33.848357 19351 raft_consensus.cc:3037] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:33.851084 19191 raft_consensus.cc:2454] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e597076e95f24332be8c2fd7a41f0db8 in term 1.
I20260811 07:07:33.851318 19351 raft_consensus.cc:2454] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e597076e95f24332be8c2fd7a41f0db8 in term 1.
I20260811 07:07:33.851588 18966 leader_election.cc:302] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dfdc34d8fb7d4457944bd7fa4df4e2a2, e597076e95f24332be8c2fd7a41f0db8; no voters:
I20260811 07:07:33.851923 19438 raft_consensus.cc:2781] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:33.852479 19438 raft_consensus.cc:686] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 1 LEADER]: Becoming Leader. State: Replica: e597076e95f24332be8c2fd7a41f0db8, State: Running, Role: LEADER
I20260811 07:07:33.853041 19438 consensus_queue.cc:237] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } }
I20260811 07:07:33.858402 18875 catalog_manager.cc:5495] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e597076e95f24332be8c2fd7a41f0db8 (127.30.73.65). New cstate: current_term: 1 leader_uuid: "e597076e95f24332be8c2fd7a41f0db8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e597076e95f24332be8c2fd7a41f0db8" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 } health_report { overall_health: UNKNOWN } } }
I20260811 07:07:33.896898 19424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.890814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43122 (local address 127.30.73.65:38027)
0811 07:07:33.891052 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.891059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.891157 (+ 98us) server_negotiation.cc:407] Connection header received
0811 07:07:33.891446 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.891450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.891562 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.891750 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:07:33.892157 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.892890 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.894506 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.894936 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.895082 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.895646 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:07:33.896220 (+ 574us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:07:33.896391 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.896477 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.896566 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 07:07:33.903776 19248 tablet.cc:2369] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:07:33.905972 19191 raft_consensus.cc:1261] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [term 1 FOLLOWER]: Refusing update from remote peer e597076e95f24332be8c2fd7a41f0db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:33.906010 19351 raft_consensus.cc:1261] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [term 1 FOLLOWER]: Refusing update from remote peer e597076e95f24332be8c2fd7a41f0db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:33.907054 19438 consensus_queue.cc:1035] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfdc34d8fb7d4457944bd7fa4df4e2a2" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 33905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:33.907430 19442 consensus_queue.cc:1035] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dd79b5a7a34c5e8d8b6f5c07dc5a4d" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 37429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:07:33.913905 19090 tablet.cc:2369] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:07:33.916435 19407 tablet.cc:2369] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:07:33.935457 18875 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:33.935781 18875 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:33.939811 18875 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a07970aa01843aab5297deedb00080e: Sending DeleteTablet for 3 replicas of tablet b040ff247cfe4a78bf16fd4e054934ff
I20260811 07:07:33.941035 19018 tablet_service.cc:1514] Processing DeleteTablet for tablet b040ff247cfe4a78bf16fd4e054934ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:33 UTC) from {username='slave'} at 127.0.0.1:43116
I20260811 07:07:33.941248 19328 tablet_service.cc:1514] Processing DeleteTablet for tablet b040ff247cfe4a78bf16fd4e054934ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:33 UTC) from {username='slave'} at 127.0.0.1:51062
I20260811 07:07:33.941290 19169 tablet_service.cc:1514] Processing DeleteTablet for tablet b040ff247cfe4a78bf16fd4e054934ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:33 UTC) from {username='slave'} at 127.0.0.1:39800
I20260811 07:07:33.942762 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 18944
I20260811 07:07:33.984004 19458 tablet_replica.cc:330] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8: stopping tablet replica
I20260811 07:07:33.984738 19458 raft_consensus.cc:2229] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:07:33.985620 19458 raft_consensus.cc:2258] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:33.990319 19424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:33.945940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43136 (local address 127.30.73.65:38027)
0811 07:07:33.946495 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:33.946505 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:33.968376 (+ 21871us) server_negotiation.cc:407] Connection header received
0811 07:07:33.969082 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:33.969092 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:33.969281 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:33.969397 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:33.970400 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.972081 (+ 1681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.982055 (+ 9974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:33.983048 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:33.983188 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:33.987789 (+ 4601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:33.987806 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:33.987832 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:33.988941 (+ 1109us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:33.989030 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:33.989068 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:33.989206 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:33.989546 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 07:07:33.989724 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386}
I20260811 07:07:33.991781 19084 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:33.993531 19461 tablet_replica.cc:330] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: stopping tablet replica
I20260811 07:07:33.994180 19461 raft_consensus.cc:2229] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:33.994819 19461 raft_consensus.cc:2258] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:33.995823 19459 tablet_replica.cc:330] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: stopping tablet replica
I20260811 07:07:33.996279 19459 raft_consensus.cc:2229] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:33.996871 19459 raft_consensus.cc:2258] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:33.998546 19461 ts_tablet_manager.cc:1905] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:33.999788 19459 ts_tablet_manager.cc:1905] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:34.004642 19461 ts_tablet_manager.cc:1918] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:34.004853 19461 log.cc:1196] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/b040ff247cfe4a78bf16fd4e054934ff
I20260811 07:07:34.005365 19461 ts_tablet_manager.cc:1939] T b040ff247cfe4a78bf16fd4e054934ff P dfdc34d8fb7d4457944bd7fa4df4e2a2: Deleting consensus metadata
I20260811 07:07:34.007507 18861 catalog_manager.cc:4841] TS dfdc34d8fb7d4457944bd7fa4df4e2a2 (127.30.73.66:33905): tablet b040ff247cfe4a78bf16fd4e054934ff (table test-table [id=d7c2089c75fa44edbb9ae1d757a5cd66]) successfully deleted
I20260811 07:07:34.007690 19459 ts_tablet_manager.cc:1918] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:34.007920 19459 log.cc:1196] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/b040ff247cfe4a78bf16fd4e054934ff
I20260811 07:07:34.008541 19459 ts_tablet_manager.cc:1939] T b040ff247cfe4a78bf16fd4e054934ff P a5dd79b5a7a34c5e8d8b6f5c07dc5a4d: Deleting consensus metadata
I20260811 07:07:34.010771 18861 catalog_manager.cc:4841] TS a5dd79b5a7a34c5e8d8b6f5c07dc5a4d (127.30.73.67:37429): tablet b040ff247cfe4a78bf16fd4e054934ff (table test-table [id=d7c2089c75fa44edbb9ae1d757a5cd66]) successfully deleted
I20260811 07:07:33.993510 19458 ts_tablet_manager.cc:1905] T b040ff247cfe4a78bf16fd4e054934ff P e597076e95f24332be8c2fd7a41f0db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:34.103957 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 18944
I20260811 07:07:34.127832 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 19095
W20260811 07:07:34.127878 18860 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.73.65:38027 (error 108)
I20260811 07:07:34.130105 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:34.129572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38027 (local address 127.0.0.1:43152)
0811 07:07:34.129753 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:34.129914 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260811 07:07:34.130399 18860 catalog_manager.cc:4584] TS e597076e95f24332be8c2fd7a41f0db8 (127.30.73.65:38027): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b040ff247cfe4a78bf16fd4e054934ff: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38027: connect: Connection refused (error 111)
I20260811 07:07:34.135267 19425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:34.128780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39808 (local address 127.30.73.66:33905)
0811 07:07:34.128998 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:34.129004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:34.129069 (+ 65us) server_negotiation.cc:407] Connection header received
0811 07:07:34.129262 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:34.129271 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:34.129382 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:34.129497 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:34.130050 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:34.130938 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:34.132183 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:34.132584 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:34.132680 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:34.133611 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:34.133620 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:34.133633 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:34.134531 (+ 898us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:34.134578 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:34.134599 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:34.134695 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:34.134827 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 07:07:34.134915 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:07:34.136044 19238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:34.184607 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:34.183711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38027 (local address 127.0.0.1:43156)
0811 07:07:34.184113 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:34.184298 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
I20260811 07:07:34.186085 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:34.185523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38027 (local address 127.0.0.1:43172)
0811 07:07:34.185734 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:34.185875 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 07:07:34.227815 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 19095
I20260811 07:07:34.246628 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:34.246166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38027 (local address 127.0.0.1:43180)
0811 07:07:34.246369 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:34.246475 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 07:07:34.247635 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:34.247296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38027 (local address 127.0.0.1:43192)
0811 07:07:34.247444 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:34.247520 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 07:07:34.250141 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 19250
I20260811 07:07:34.257313 19428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:34.250913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51076 (local address 127.30.73.67:37429)
0811 07:07:34.251145 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:34.251150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:34.251168 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:07:34.251226 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:34.251230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:34.251318 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:34.251432 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:34.251812 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:34.252714 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:34.254098 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:34.254587 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:34.254694 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:34.255786 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:34.255794 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:34.255810 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:34.256518 (+ 708us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:34.256570 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:34.256593 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:34.256697 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:34.256834 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 07:07:34.256933 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:07:34.258103 19399 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:34.328497 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:34.327950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38027 (local address 127.0.0.1:43198)
0811 07:07:34.328217 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:34.328314 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260811 07:07:34.329658 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:34.329215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38027 (local address 127.0.0.1:43212)
0811 07:07:34.329449 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:34.329534 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260811 07:07:34.349462 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 19250
I20260811 07:07:34.372756 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 18843
I20260811 07:07:34.373994 18908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:34.489159 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 18843
2026-08-11T07:07:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3075 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:07:34 dist-test-slave-69rg krb5kdc[19470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:07:34 dist-test-slave-69rg krb5kdc[19470](info): set up 2 sockets
Aug 11 07:07:34 dist-test-slave-69rg krb5kdc[19470](info): commencing operation
krb5kdc: starting...
W20260811 07:07:35.745569 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:07:35 dist-test-slave-69rg krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:07:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:07:36.085940 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40011
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:40011
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:36.513319 19485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:36.513715 19485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:36.513927 19485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:36.522009 19485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:36.522156 19485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:36.522253 19485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:36.522352 19485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:36.522442 19485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:36.534441 19485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:40011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:36.536379 19485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:36.538141 19485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:36.553706 19493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:36.553613 19492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:36.553682 19496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:36.560216 19485 server_base.cc:1034] running on GCE node
I20260811 07:07:36.561450 19485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:36.563635 19485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:36.564973 19485 hybrid_clock.cc:648] HybridClock initialized: now 1786432056564881 us; error 75 us; skew 500 ppm
I20260811 07:07:36.565491 19485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:36 dist-test-slave-69rg krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432056, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:36.576298 19485 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:07:36.578732 19485 webserver.cc:460] Webserver started at http://127.30.73.126:42819/ using document root <none> and password file <none>
I20260811 07:07:36.579743 19485 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:36.579928 19485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:36.580339 19485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:36.584439 19485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "7b5a3c1f533142829b7df61689a641fd"
format_stamp: "Formatted at 2026-08-11 07:07:36 on dist-test-slave-69rg"
server_key: "707b5ab25ca1185e149948d969d173bd"
server_key_iv: "c1bb55de3edfbdaada19f9bf364205f0"
server_key_version: "encryptionkey@0"
I20260811 07:07:36.585413 19485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "7b5a3c1f533142829b7df61689a641fd"
format_stamp: "Formatted at 2026-08-11 07:07:36 on dist-test-slave-69rg"
server_key: "707b5ab25ca1185e149948d969d173bd"
server_key_iv: "c1bb55de3edfbdaada19f9bf364205f0"
server_key_version: "encryptionkey@0"
I20260811 07:07:36.592105 19485 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:07:36.596172 19504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:36.597751 19485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:07:36.598016 19485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "7b5a3c1f533142829b7df61689a641fd"
format_stamp: "Formatted at 2026-08-11 07:07:36 on dist-test-slave-69rg"
server_key: "707b5ab25ca1185e149948d969d173bd"
server_key_iv: "c1bb55de3edfbdaada19f9bf364205f0"
server_key_version: "encryptionkey@0"
I20260811 07:07:36.598282 19485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:36.629791 19485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:36.635092 19485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:36.635485 19485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:36.658120 19485 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:40011
I20260811 07:07:36.658128 19562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:40011 every 8 connection(s)
I20260811 07:07:36.659955 19485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:36.664840 19563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:36.666590 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 19485
I20260811 07:07:36.666815 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:07:36.667335 31013 external_mini_cluster.cc:1428] Setting key 5a517098768b32743eb362f343fb5997
I20260811 07:07:36.681749 19563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd: Bootstrap starting.
Aug 11 07:07:36 dist-test-slave-69rg krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:36.685945 19563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:36.687631 19563 log.cc:824] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:36.691758 19563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd: No bootstrap required, opened a new log
I20260811 07:07:36.695026 19566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:36.669782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42568 (local address 127.30.73.126:40011)
0811 07:07:36.670800 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:36.670817 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:36.670895 (+ 78us) server_negotiation.cc:407] Connection header received
0811 07:07:36.672815 (+ 1920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:36.672860 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:36.673478 (+ 618us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:36.674038 (+ 560us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:36.675664 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:36.677781 (+ 2117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:36.679389 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:36.680519 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:36.680723 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:36.685636 (+ 4913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:36.685652 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:36.685677 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:36.685734 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:36.689984 (+ 4250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:36.690749 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:36.690759 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:36.690768 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:36.690996 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:36.691374 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:36.691379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:36.691382 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:36.692154 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:36.692544 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:36.692883 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 07:07:36.693382 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":411,"threads_started":1}
I20260811 07:07:36.702194 19563 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b5a3c1f533142829b7df61689a641fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40011 } }
I20260811 07:07:36.702716 19563 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:36.702850 19563 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b5a3c1f533142829b7df61689a641fd, State: Initialized, Role: FOLLOWER
I20260811 07:07:36.703570 19563 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b5a3c1f533142829b7df61689a641fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40011 } }
I20260811 07:07:36.703909 19563 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:36.704077 19563 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:36.704272 19563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:36.706804 19563 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b5a3c1f533142829b7df61689a641fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40011 } }
I20260811 07:07:36.707386 19563 leader_election.cc:302] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b5a3c1f533142829b7df61689a641fd; no voters:
I20260811 07:07:36.708164 19563 leader_election.cc:288] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:07:36.708319 19570 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:36.709175 19570 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [term 1 LEADER]: Becoming Leader. State: Replica: 7b5a3c1f533142829b7df61689a641fd, State: Running, Role: LEADER
I20260811 07:07:36.709888 19570 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b5a3c1f533142829b7df61689a641fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40011 } }
I20260811 07:07:36.710813 19563 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:36.713370 19571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b5a3c1f533142829b7df61689a641fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b5a3c1f533142829b7df61689a641fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40011 } } }
I20260811 07:07:36.713850 19571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:36.713487 19572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b5a3c1f533142829b7df61689a641fd. Latest consensus state: current_term: 1 leader_uuid: "7b5a3c1f533142829b7df61689a641fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b5a3c1f533142829b7df61689a641fd" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40011 } } }
I20260811 07:07:36.713987 19572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:36.715585 19578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:36.720738 19578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:36.732082 19578 catalog_manager.cc:1347] Generated new cluster ID: ec58d84fc12c43e58c11a998a73cf2e7
I20260811 07:07:36.732261 19578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:36.752275 19578 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:07:36.753994 19578 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:36.767333 19578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd: Generated new TSK 0
I20260811 07:07:36.768698 19578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:07:36.862305 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40011
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:37.293581 19595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:37.294011 19595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:37.294127 19595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:37.302110 19595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:37.302276 19595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:37.302415 19595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:07:37.313838 19595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:37.315672 19595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:37.317390 19595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:37.334544 19600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:37.334435 19601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:37.334513 19604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:37.335376 19595 server_base.cc:1034] running on GCE node
I20260811 07:07:37.336087 19595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:37.337231 19595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:37.338450 19595 hybrid_clock.cc:648] HybridClock initialized: now 1786432057338388 us; error 47 us; skew 500 ppm
I20260811 07:07:37.338860 19595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:37 dist-test-slave-69rg krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432057, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:37.342790 19595 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:07:37.344733 19595 webserver.cc:460] Webserver started at http://127.30.73.65:46137/ using document root <none> and password file <none>
I20260811 07:07:37.345616 19595 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:37.345763 19595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:37.346225 19595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:37.350107 19595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "622cab8f2e744fcbb332c877b38502e2"
format_stamp: "Formatted at 2026-08-11 07:07:37 on dist-test-slave-69rg"
server_key: "547661ef8232f0b13b84a1e395ac5387"
server_key_iv: "01855d983b67120a2c95606ff4d12439"
server_key_version: "encryptionkey@0"
I20260811 07:07:37.351011 19595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "622cab8f2e744fcbb332c877b38502e2"
format_stamp: "Formatted at 2026-08-11 07:07:37 on dist-test-slave-69rg"
server_key: "547661ef8232f0b13b84a1e395ac5387"
server_key_iv: "01855d983b67120a2c95606ff4d12439"
server_key_version: "encryptionkey@0"
I20260811 07:07:37.357213 19595 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 07:07:37.361440 19613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:37.363087 19595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 07:07:37.363298 19595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "622cab8f2e744fcbb332c877b38502e2"
format_stamp: "Formatted at 2026-08-11 07:07:37 on dist-test-slave-69rg"
server_key: "547661ef8232f0b13b84a1e395ac5387"
server_key_iv: "01855d983b67120a2c95606ff4d12439"
server_key_version: "encryptionkey@0"
I20260811 07:07:37.363536 19595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:37.387486 19595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:37.392884 19595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:37.393273 19595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:37.394593 19595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:37.396334 19595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:37.396461 19595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:37.396636 19595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:37.396716 19595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:37.450788 19595 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:38841
I20260811 07:07:37.450951 19748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:38841 every 8 connection(s)
I20260811 07:07:37.452716 19595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:07:37.460600 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 19595
I20260811 07:07:37.460860 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:07:37.461613 31013 external_mini_cluster.cc:1428] Setting key 7e5c4bc5a818da9b11ae8bc9bf8679ad
Aug 11 07:07:37 dist-test-slave-69rg krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432057, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:37.486779 19751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:37.456430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:46777 (local address 127.30.73.126:40011)
0811 07:07:37.457070 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:37.457078 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:37.458496 (+ 1418us) server_negotiation.cc:407] Connection header received
0811 07:07:37.461249 (+ 2753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:37.461258 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:37.461384 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:37.461534 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:37.464583 (+ 3049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:37.465856 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:37.469523 (+ 3667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:37.470434 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:37.470627 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:37.477140 (+ 6513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:37.477153 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:37.477160 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:37.477232 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:37.481790 (+ 4558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:37.483071 (+ 1281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:37.483077 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:37.483080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:37.483241 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:37.483816 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:37.483821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:37.483823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:37.484322 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:37.484501 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:37.485870 (+ 1369us) server_negotiation.cc:299] Negotiation successful
0811 07:07:37.486255 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":293,"threads_started":1}
I20260811 07:07:37.488588 19752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:37.457155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40011 (local address 127.30.73.65:46777)
0811 07:07:37.458263 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:37.458330 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:37.460618 (+ 2288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:37.462002 (+ 1384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:37.462021 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:37.463105 (+ 1084us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:37.464286 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:37.464336 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:37.466146 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:37.466154 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:37.469237 (+ 3083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:37.469272 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:37.470816 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:37.470828 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:37.471279 (+ 451us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:37.472387 (+ 1108us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:37.472432 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:37.476678 (+ 4246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:37.482124 (+ 5446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:37.482142 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:37.482174 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:37.482861 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:37.483400 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:37.483404 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:37.483407 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:37.483656 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:37.484514 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:37.484528 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:37.485210 (+ 682us) client_negotiation.cc:769] Sending connection context
0811 07:07:37.485627 (+ 417us) client_negotiation.cc:240] Negotiation successful
0811 07:07:37.486448 (+ 821us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"thread_start_us":387,"threads_started":1}
I20260811 07:07:37.490866 19749 heartbeater.cc:347] Connected to a master server at 127.30.73.126:40011
I20260811 07:07:37.491370 19749 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:37.492544 19749 heartbeater.cc:511] Master 127.30.73.126:40011 requested a full tablet report, sending...
I20260811 07:07:37.496155 19523 ts_manager.cc:194] Registered new tserver with Master: 622cab8f2e744fcbb332c877b38502e2 (127.30.73.65:38841)
I20260811 07:07:37.498899 19523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:46777
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:07:37.557394 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40011
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:37.983019 19755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:37.983412 19755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:37.983644 19755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:37.994284 19755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:37.994578 19755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:37.994851 19755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:07:38.011137 19755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:38.013293 19755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:38.015340 19755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:38.033208 19761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:38.033164 19764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:38.033141 19762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:38.034214 19755 server_base.cc:1034] running on GCE node
I20260811 07:07:38.035036 19755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:38.036278 19755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:38.037535 19755 hybrid_clock.cc:648] HybridClock initialized: now 1786432058037483 us; error 50 us; skew 500 ppm
I20260811 07:07:38.037985 19755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:38 dist-test-slave-69rg krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432058, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:38.042158 19755 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:07:38.044063 19755 webserver.cc:460] Webserver started at http://127.30.73.66:44029/ using document root <none> and password file <none>
I20260811 07:07:38.044926 19755 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:38.045061 19755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:38.045399 19755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:38.049042 19755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "6c817e77ff714f3abb9da5cfa08ed356"
format_stamp: "Formatted at 2026-08-11 07:07:38 on dist-test-slave-69rg"
server_key: "76badbdbd3b1f64b35cbc0c09c973b48"
server_key_iv: "ec75af8948893ae63c27786dcffcb321"
server_key_version: "encryptionkey@0"
I20260811 07:07:38.050024 19755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "6c817e77ff714f3abb9da5cfa08ed356"
format_stamp: "Formatted at 2026-08-11 07:07:38 on dist-test-slave-69rg"
server_key: "76badbdbd3b1f64b35cbc0c09c973b48"
server_key_iv: "ec75af8948893ae63c27786dcffcb321"
server_key_version: "encryptionkey@0"
I20260811 07:07:38.056377 19755 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:07:38.060878 19772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:38.063724 19755 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:07:38.063994 19755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "6c817e77ff714f3abb9da5cfa08ed356"
format_stamp: "Formatted at 2026-08-11 07:07:38 on dist-test-slave-69rg"
server_key: "76badbdbd3b1f64b35cbc0c09c973b48"
server_key_iv: "ec75af8948893ae63c27786dcffcb321"
server_key_version: "encryptionkey@0"
I20260811 07:07:38.064404 19755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:38.084578 19755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:38.090247 19755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:38.090643 19755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:38.091938 19755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:38.093653 19755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:38.093784 19755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:38.093962 19755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:38.094048 19755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:38.136560 19755 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:44033
I20260811 07:07:38.136600 19905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:44033 every 8 connection(s)
I20260811 07:07:38.138254 19755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:07:38.141131 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 19755
I20260811 07:07:38.141460 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:07:38.142397 31013 external_mini_cluster.cc:1428] Setting key 5c90f1f1f99bdc611fe1eaeab6bd1162
Aug 11 07:07:38 dist-test-slave-69rg krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432058, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:38.167840 19909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.141721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:59091 (local address 127.30.73.126:40011)
0811 07:07:38.142642 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:38.142651 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:38.143733 (+ 1082us) server_negotiation.cc:407] Connection header received
0811 07:07:38.146839 (+ 3106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:38.146844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:38.146931 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:38.147042 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:38.149925 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.150828 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.154074 (+ 3246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.154774 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.154914 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.160420 (+ 5506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:38.160428 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:38.160431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:38.160480 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:38.163731 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:38.164772 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:38.164777 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:38.164780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:38.164923 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:38.165459 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:38.165463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:38.165465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:38.165811 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:38.166053 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:38.166942 (+ 889us) server_negotiation.cc:299] Negotiation successful
0811 07:07:38.167251 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":567,"threads_started":1}
I20260811 07:07:38.169257 19910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.142375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40011 (local address 127.30.73.66:59091)
0811 07:07:38.143480 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:38.143570 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:38.146426 (+ 2856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:38.147412 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:38.147429 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:38.148553 (+ 1124us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:38.149632 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.149669 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.150990 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.150999 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.153777 (+ 2778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.153800 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.155092 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.155102 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.155519 (+ 417us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.156555 (+ 1036us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:38.156601 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:38.160049 (+ 3448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:38.163964 (+ 3915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:38.163977 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:38.164008 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:38.164606 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:38.165048 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:38.165054 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:38.165058 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:38.165310 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:38.165997 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:38.166007 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:38.166495 (+ 488us) client_negotiation.cc:769] Sending connection context
0811 07:07:38.166829 (+ 334us) client_negotiation.cc:240] Negotiation successful
0811 07:07:38.167601 (+ 772us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":448,"threads_started":1}
I20260811 07:07:38.171567 19907 heartbeater.cc:347] Connected to a master server at 127.30.73.126:40011
I20260811 07:07:38.172044 19907 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:38.173605 19907 heartbeater.cc:511] Master 127.30.73.126:40011 requested a full tablet report, sending...
I20260811 07:07:38.176110 19523 ts_manager.cc:194] Registered new tserver with Master: 6c817e77ff714f3abb9da5cfa08ed356 (127.30.73.66:44033)
I20260811 07:07:38.177608 19523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:59091
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:07:38.241791 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40011
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:07:38.504628 19749 heartbeater.cc:503] Master 127.30.73.126:40011 was elected leader, sending a full tablet report...
W20260811 07:07:38.720073 19915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:38.720577 19915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:38.720796 19915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:38.731583 19915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:38.731784 19915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:38.732002 19915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:07:38.745260 19915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:40011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:38.747354 19915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:38.749598 19915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:38.767937 19922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:38.767835 19924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:38.768574 19921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:38.769518 19915 server_base.cc:1034] running on GCE node
I20260811 07:07:38.770618 19915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:38.772164 19915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:38.773475 19915 hybrid_clock.cc:648] HybridClock initialized: now 1786432058773402 us; error 88 us; skew 500 ppm
I20260811 07:07:38.774030 19915 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:38 dist-test-slave-69rg krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432058, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:38.778645 19915 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:07:38.780854 19915 webserver.cc:460] Webserver started at http://127.30.73.67:42791/ using document root <none> and password file <none>
I20260811 07:07:38.781752 19915 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:38.781951 19915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:38.782346 19915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:38.786955 19915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "7346869e107044339f3229e7c9f9c8fc"
format_stamp: "Formatted at 2026-08-11 07:07:38 on dist-test-slave-69rg"
server_key: "8f2e7d4874fd1e5a2b021726932bc6a7"
server_key_iv: "e704b5beebb0bbdd456a0865c6d98ce9"
server_key_version: "encryptionkey@0"
I20260811 07:07:38.788094 19915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "7346869e107044339f3229e7c9f9c8fc"
format_stamp: "Formatted at 2026-08-11 07:07:38 on dist-test-slave-69rg"
server_key: "8f2e7d4874fd1e5a2b021726932bc6a7"
server_key_iv: "e704b5beebb0bbdd456a0865c6d98ce9"
server_key_version: "encryptionkey@0"
I20260811 07:07:38.795459 19915 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260811 07:07:38.800447 19932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:38.802373 19915 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:07:38.802644 19915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "7346869e107044339f3229e7c9f9c8fc"
format_stamp: "Formatted at 2026-08-11 07:07:38 on dist-test-slave-69rg"
server_key: "8f2e7d4874fd1e5a2b021726932bc6a7"
server_key_iv: "e704b5beebb0bbdd456a0865c6d98ce9"
server_key_version: "encryptionkey@0"
I20260811 07:07:38.802933 19915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:38.826018 19915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:38.831739 19915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:38.832111 19915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:38.833413 19915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:38.835321 19915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:38.835446 19915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:38.835632 19915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:38.835718 19915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:38.879096 19915 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:41643
I20260811 07:07:38.879154 20058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:41643 every 8 connection(s)
I20260811 07:07:38.880887 19915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:07:38.888943 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 19915
I20260811 07:07:38.889205 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:07:38.889938 31013 external_mini_cluster.cc:1428] Setting key a50457625ed7347001283d0cb901ec8d
Aug 11 07:07:38 dist-test-slave-69rg krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432058, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:38.906030 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.884241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:48783 (local address 127.30.73.126:40011)
0811 07:07:38.884869 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:38.884876 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:38.886005 (+ 1129us) server_negotiation.cc:407] Connection header received
0811 07:07:38.888262 (+ 2257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:38.888268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:38.888386 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:38.888537 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:38.891283 (+ 2746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.892340 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.894496 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.894953 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.895061 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.899102 (+ 4041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:38.899107 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:38.899111 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:38.899154 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:38.902090 (+ 2936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:38.903028 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:38.903033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:38.903036 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:38.903176 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:38.903684 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:38.903688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:38.903690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:38.904046 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:38.904185 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:38.905266 (+ 1081us) server_negotiation.cc:299] Negotiation successful
0811 07:07:38.905552 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":336,"threads_started":1}
I20260811 07:07:38.907464 20063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.884802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:40011 (local address 127.30.73.67:48783)
0811 07:07:38.885693 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:38.885754 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:38.887908 (+ 2154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:38.888948 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:38.888962 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:38.889988 (+ 1026us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:38.891005 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.891037 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.892548 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.892553 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.894338 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.894354 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.895176 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.895181 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.895413 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.896178 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:38.896211 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:38.898823 (+ 2612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:38.902240 (+ 3417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:38.902249 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:38.902267 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:38.902908 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:38.903278 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:38.903281 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:38.903284 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:38.903531 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:38.904196 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:38.904207 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:38.904757 (+ 550us) client_negotiation.cc:769] Sending connection context
0811 07:07:38.905111 (+ 354us) client_negotiation.cc:240] Negotiation successful
0811 07:07:38.905826 (+ 715us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":342,"threads_started":1}
I20260811 07:07:38.909183 20060 heartbeater.cc:347] Connected to a master server at 127.30.73.126:40011
I20260811 07:07:38.909613 20060 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:38.910614 20060 heartbeater.cc:511] Master 127.30.73.126:40011 requested a full tablet report, sending...
I20260811 07:07:38.912514 19523 ts_manager.cc:194] Registered new tserver with Master: 7346869e107044339f3229e7c9f9c8fc (127.30.73.67:41643)
I20260811 07:07:38.913501 19523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:48783
I20260811 07:07:38.919262 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:07:38.940116 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.924141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42572 (local address 127.30.73.126:40011)
0811 07:07:38.924351 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:38.924357 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:38.924885 (+ 528us) server_negotiation.cc:407] Connection header received
0811 07:07:38.925015 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:38.925019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:38.925096 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:38.925209 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:38.926855 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.927669 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.929173 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.929640 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.929744 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.933333 (+ 3589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:38.933339 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:38.933342 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:38.933386 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:38.936717 (+ 3331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:38.937684 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:38.937689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:38.937692 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:38.937896 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:38.938398 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:38.938403 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:38.938407 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:38.938788 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:38.939121 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:38.939537 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 07:07:38.939762 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:07:38.945341 19523 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:07:38.953387 19523 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:07:38.985759 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.971256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41643 (local address 127.0.0.1:40700)
0811 07:07:38.978113 (+ 6857us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:38.978137 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:38.978309 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:38.978979 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:38.978984 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:38.979019 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:38.979536 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.979547 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.981084 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.981089 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.983133 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.983147 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.984582 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.984588 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.984826 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.984897 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 07:07:38.985070 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 07:07:38.985294 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6723,"thread_start_us":6497,"threads_started":1}
I20260811 07:07:38.985749 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.971684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40700 (local address 127.30.73.67:41643)
0811 07:07:38.977555 (+ 5871us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:38.977564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:38.978263 (+ 699us) server_negotiation.cc:407] Connection header received
0811 07:07:38.978521 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:38.978529 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:38.978761 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:38.979006 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:38.979760 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.980880 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.983321 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.984342 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.984513 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.984805 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:38.985124 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 07:07:38.985321 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5669,"thread_start_us":5467,"threads_started":1}
I20260811 07:07:38.986291 20077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.970074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36984 (local address 127.30.73.66:44033)
0811 07:07:38.970872 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:38.970884 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:38.970929 (+ 45us) server_negotiation.cc:407] Connection header received
0811 07:07:38.971391 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:38.971400 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:38.971747 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:38.972041 (+ 294us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:38.973619 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.975951 (+ 2332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.981587 (+ 5636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.984243 (+ 2656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.984416 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.984764 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:38.985642 (+ 878us) server_negotiation.cc:299] Negotiation successful
0811 07:07:38.985883 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":374,"threads_started":1}
I20260811 07:07:38.987298 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.969733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:44033 (local address 127.0.0.1:36984)
0811 07:07:38.970723 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:38.970835 (+ 112us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:38.971048 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:38.972307 (+ 1259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:38.972318 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:38.972365 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:38.973034 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.973054 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.976152 (+ 3098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.976162 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.981251 (+ 5089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.981276 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.985059 (+ 3783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.985069 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.985327 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.985382 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 07:07:38.986606 (+ 1224us) client_negotiation.cc:240] Negotiation successful
0811 07:07:38.986770 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":1,"thread_start_us":432,"threads_started":1}
I20260811 07:07:38.992204 19987 tablet_service.cc:1467] Processing CreateTablet for tablet 73f558e27c814b61a718a902965eed26 (DEFAULT_TABLE table=test-table [id=4d926defb05d4dbe92c2db70158abc03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:38.992836 19830 tablet_service.cc:1467] Processing CreateTablet for tablet 73f558e27c814b61a718a902965eed26 (DEFAULT_TABLE table=test-table [id=4d926defb05d4dbe92c2db70158abc03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:38.994669 19987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73f558e27c814b61a718a902965eed26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:38.994678 19830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73f558e27c814b61a718a902965eed26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:38.998204 20081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.971256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38841 (local address 127.0.0.1:56932)
0811 07:07:38.986053 (+ 14797us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:38.986082 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:38.986242 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:38.987772 (+ 1530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:38.987778 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:38.987808 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:38.988545 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.988564 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.991865 (+ 3301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.991873 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.994337 (+ 2464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:38.994371 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.997087 (+ 2716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.997098 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:38.997326 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.997371 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 07:07:38.997482 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:07:38.997653 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14628,"mutex_wait_us":852,"thread_start_us":14225,"threads_started":1}
I20260811 07:07:38.999267 20080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:38.971807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56932 (local address 127.30.73.65:38841)
0811 07:07:38.976874 (+ 5067us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:38.976888 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:38.986229 (+ 9341us) server_negotiation.cc:407] Connection header received
0811 07:07:38.986475 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:38.986485 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:38.986883 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:38.987183 (+ 300us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:38.988982 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.991505 (+ 2523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.994668 (+ 3163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:38.996363 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:38.996521 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:38.996819 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:38.998622 (+ 1803us) server_negotiation.cc:299] Negotiation successful
0811 07:07:38.998879 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4785,"thread_start_us":4535,"threads_started":1}
I20260811 07:07:39.005946 19672 tablet_service.cc:1467] Processing CreateTablet for tablet 73f558e27c814b61a718a902965eed26 (DEFAULT_TABLE table=test-table [id=4d926defb05d4dbe92c2db70158abc03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:39.008244 19672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73f558e27c814b61a718a902965eed26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:39.016800 20083 tablet_bootstrap.cc:492] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: Bootstrap starting.
I20260811 07:07:39.031302 20082 tablet_bootstrap.cc:492] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: Bootstrap starting.
I20260811 07:07:39.036726 20082 tablet_bootstrap.cc:654] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:39.038362 20083 tablet_bootstrap.cc:654] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:39.038592 20082 log.cc:824] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:39.040037 20083 log.cc:824] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:39.041695 20086 tablet_bootstrap.cc:492] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: Bootstrap starting.
I20260811 07:07:39.043287 20082 tablet_bootstrap.cc:492] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: No bootstrap required, opened a new log
I20260811 07:07:39.043685 20082 ts_tablet_manager.cc:1397] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260811 07:07:39.043915 20083 tablet_bootstrap.cc:492] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: No bootstrap required, opened a new log
I20260811 07:07:39.044260 20083 ts_tablet_manager.cc:1397] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.000s
I20260811 07:07:39.046998 20086 tablet_bootstrap.cc:654] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:39.049036 20086 log.cc:824] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:39.054246 20086 tablet_bootstrap.cc:492] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: No bootstrap required, opened a new log
I20260811 07:07:39.054698 20086 ts_tablet_manager.cc:1397] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260811 07:07:39.055732 20083 raft_consensus.cc:348] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } }
I20260811 07:07:39.056279 20083 raft_consensus.cc:374] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:39.056077 20082 raft_consensus.cc:348] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } }
I20260811 07:07:39.056425 20083 raft_consensus.cc:729] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c817e77ff714f3abb9da5cfa08ed356, State: Initialized, Role: FOLLOWER
I20260811 07:07:39.056593 20082 raft_consensus.cc:374] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:39.056721 20082 raft_consensus.cc:729] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7346869e107044339f3229e7c9f9c8fc, State: Initialized, Role: FOLLOWER
I20260811 07:07:39.057245 20083 consensus_queue.cc:260] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } }
I20260811 07:07:39.057549 20082 consensus_queue.cc:260] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } }
I20260811 07:07:39.058691 19907 heartbeater.cc:503] Master 127.30.73.126:40011 was elected leader, sending a full tablet report...
I20260811 07:07:39.059548 20083 ts_tablet_manager.cc:1428] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: Time spent starting tablet: real 0.015s user 0.009s sys 0.006s
I20260811 07:07:39.062728 20060 heartbeater.cc:503] Master 127.30.73.126:40011 was elected leader, sending a full tablet report...
I20260811 07:07:39.063529 20082 ts_tablet_manager.cc:1428] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: Time spent starting tablet: real 0.020s user 0.012s sys 0.008s
I20260811 07:07:39.068593 20086 raft_consensus.cc:348] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } }
I20260811 07:07:39.069270 20086 raft_consensus.cc:374] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:39.069403 20086 raft_consensus.cc:729] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622cab8f2e744fcbb332c877b38502e2, State: Initialized, Role: FOLLOWER
I20260811 07:07:39.070267 20086 consensus_queue.cc:260] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } }
I20260811 07:07:39.072393 20086 ts_tablet_manager.cc:1428] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
W20260811 07:07:39.133098 20061 tablet.cc:2369] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:07:39.141150 19908 tablet.cc:2369] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:07:39.206571 19750 tablet.cc:2369] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:07:39.242185 20091 raft_consensus.cc:482] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:39.242703 20091 raft_consensus.cc:504] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } }
I20260811 07:07:39.245045 20091 leader_election.cc:288] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c817e77ff714f3abb9da5cfa08ed356 (127.30.73.66:44033), 7346869e107044339f3229e7c9f9c8fc (127.30.73.67:41643)
I20260811 07:07:39.253808 20092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:39.245414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:44033 (local address 127.30.73.65:52181)
0811 07:07:39.246352 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:39.246418 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:39.246695 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:39.247214 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:39.247220 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:39.247257 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:39.247790 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:39.247806 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.249261 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.249268 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:39.251221 (+ 1953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:39.251236 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.252850 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.252856 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:39.253052 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:39.253104 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 07:07:39.253226 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 07:07:39.253450 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"thread_start_us":510,"threads_started":1}
I20260811 07:07:39.253835 20077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:39.245856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:52181 (local address 127.30.73.66:44033)
0811 07:07:39.246174 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:39.246184 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:39.246537 (+ 353us) server_negotiation.cc:407] Connection header received
0811 07:07:39.246910 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:39.246919 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:39.247038 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:39.247159 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:39.248001 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.249101 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.251432 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.252610 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.252760 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:39.252829 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:39.253277 (+ 448us) server_negotiation.cc:299] Negotiation successful
0811 07:07:39.253473 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 07:07:39.254405 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:39.246918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:37195 (local address 127.30.73.67:41643)
0811 07:07:39.247158 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:39.247165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:39.247525 (+ 360us) server_negotiation.cc:407] Connection header received
0811 07:07:39.247757 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:39.247765 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:39.247874 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:39.247982 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:39.248772 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.249958 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.252166 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.253241 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.253404 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:39.253482 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:39.253935 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 07:07:39.254121 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:07:39.254463 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:39.246406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:41643 (local address 127.30.73.65:37195)
0811 07:07:39.247398 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:39.247417 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:39.247593 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:39.248012 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:39.248016 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:39.248043 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:39.248541 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:39.248558 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.250155 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.250160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:39.251964 (+ 1804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:39.251981 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.253507 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.253514 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:39.253714 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:39.253747 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:07:39.253901 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 07:07:39.254043 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"spinlock_wait_cycles":24960,"thread_start_us":761,"threads_started":1}
I20260811 07:07:39.255481 19851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f558e27c814b61a718a902965eed26" candidate_uuid: "622cab8f2e744fcbb332c877b38502e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c817e77ff714f3abb9da5cfa08ed356" is_pre_election: true
I20260811 07:07:39.255927 20007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f558e27c814b61a718a902965eed26" candidate_uuid: "622cab8f2e744fcbb332c877b38502e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7346869e107044339f3229e7c9f9c8fc" is_pre_election: true
I20260811 07:07:39.256168 19851 raft_consensus.cc:2454] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622cab8f2e744fcbb332c877b38502e2 in term 0.
I20260811 07:07:39.256527 20007 raft_consensus.cc:2454] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 622cab8f2e744fcbb332c877b38502e2 in term 0.
I20260811 07:07:39.257100 19619 leader_election.cc:302] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622cab8f2e744fcbb332c877b38502e2, 6c817e77ff714f3abb9da5cfa08ed356; no voters:
I20260811 07:07:39.257606 20091 raft_consensus.cc:2781] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:07:39.257787 20091 raft_consensus.cc:482] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:07:39.257956 20091 raft_consensus.cc:3037] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:39.260577 20091 raft_consensus.cc:504] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } }
I20260811 07:07:39.261335 20091 leader_election.cc:288] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [CANDIDATE]: Term 1 election: Requested vote from peers 6c817e77ff714f3abb9da5cfa08ed356 (127.30.73.66:44033), 7346869e107044339f3229e7c9f9c8fc (127.30.73.67:41643)
I20260811 07:07:39.261976 19851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f558e27c814b61a718a902965eed26" candidate_uuid: "622cab8f2e744fcbb332c877b38502e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c817e77ff714f3abb9da5cfa08ed356"
I20260811 07:07:39.262048 20007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f558e27c814b61a718a902965eed26" candidate_uuid: "622cab8f2e744fcbb332c877b38502e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7346869e107044339f3229e7c9f9c8fc"
I20260811 07:07:39.262231 19851 raft_consensus.cc:3037] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:39.262342 20007 raft_consensus.cc:3037] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:39.264887 20007 raft_consensus.cc:2454] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622cab8f2e744fcbb332c877b38502e2 in term 1.
I20260811 07:07:39.264897 19851 raft_consensus.cc:2454] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 622cab8f2e744fcbb332c877b38502e2 in term 1.
I20260811 07:07:39.265388 19619 leader_election.cc:302] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622cab8f2e744fcbb332c877b38502e2, 6c817e77ff714f3abb9da5cfa08ed356; no voters:
I20260811 07:07:39.265755 20091 raft_consensus.cc:2781] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:39.266460 20091 raft_consensus.cc:686] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 1 LEADER]: Becoming Leader. State: Replica: 622cab8f2e744fcbb332c877b38502e2, State: Running, Role: LEADER
I20260811 07:07:39.267078 20091 consensus_queue.cc:237] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } }
I20260811 07:07:39.273391 19521 catalog_manager.cc:5495] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 622cab8f2e744fcbb332c877b38502e2 (127.30.73.65). New cstate: current_term: 1 leader_uuid: "622cab8f2e744fcbb332c877b38502e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "622cab8f2e744fcbb332c877b38502e2" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38841 } health_report { overall_health: HEALTHY } } }
I20260811 07:07:39.301433 20080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:39.294936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55386 (local address 127.30.73.65:38841)
0811 07:07:39.295202 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:39.295207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:39.295225 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:07:39.295329 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:39.295333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:39.295434 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:39.295623 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:07:39.296094 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.296919 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.298647 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.299118 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.299285 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:39.299972 (+ 687us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:07:39.300663 (+ 691us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:07:39.300878 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:39.301064 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 07:07:39.301127 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:07:39.313095 19851 raft_consensus.cc:1261] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [term 1 FOLLOWER]: Refusing update from remote peer 622cab8f2e744fcbb332c877b38502e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:39.313094 20007 raft_consensus.cc:1261] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [term 1 FOLLOWER]: Refusing update from remote peer 622cab8f2e744fcbb332c877b38502e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:39.314389 20094 consensus_queue.cc:1035] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c817e77ff714f3abb9da5cfa08ed356" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 44033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:39.314945 20091 consensus_queue.cc:1035] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7346869e107044339f3229e7c9f9c8fc" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 41643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:39.348914 19522 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:39.349392 19522 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:39.353952 19522 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b5a3c1f533142829b7df61689a641fd: Sending DeleteTablet for 3 replicas of tablet 73f558e27c814b61a718a902965eed26
I20260811 07:07:39.355629 19672 tablet_service.cc:1514] Processing DeleteTablet for tablet 73f558e27c814b61a718a902965eed26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:39 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:56932
I20260811 07:07:39.355841 19987 tablet_service.cc:1514] Processing DeleteTablet for tablet 73f558e27c814b61a718a902965eed26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:39 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:40700
I20260811 07:07:39.356331 19830 tablet_service.cc:1514] Processing DeleteTablet for tablet 73f558e27c814b61a718a902965eed26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:39 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:36984
I20260811 07:07:39.359165 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 19595
I20260811 07:07:39.366559 20109 tablet_replica.cc:330] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: stopping tablet replica
I20260811 07:07:39.368961 20109 raft_consensus.cc:2229] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:39.370457 20108 tablet_replica.cc:330] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: stopping tablet replica
I20260811 07:07:39.371140 20108 raft_consensus.cc:2229] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:39.372037 20108 raft_consensus.cc:2258] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:39.373565 20109 raft_consensus.cc:2258] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:39.377456 20107 tablet_replica.cc:330] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: stopping tablet replica
I20260811 07:07:39.377568 20109 ts_tablet_manager.cc:1905] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:39.379626 20108 ts_tablet_manager.cc:1905] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:39.380395 20107 raft_consensus.cc:2229] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:07:39.381470 20107 raft_consensus.cc:2258] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:39.386451 20109 ts_tablet_manager.cc:1918] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:39.386826 20109 log.cc:1196] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/73f558e27c814b61a718a902965eed26
I20260811 07:07:39.387674 20109 ts_tablet_manager.cc:1939] T 73f558e27c814b61a718a902965eed26 P 6c817e77ff714f3abb9da5cfa08ed356: Deleting consensus metadata
I20260811 07:07:39.387845 20107 ts_tablet_manager.cc:1905] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 07:07:39 dist-test-slave-69rg krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:07:39.390599 19510 catalog_manager.cc:4841] TS 6c817e77ff714f3abb9da5cfa08ed356 (127.30.73.66:44033): tablet 73f558e27c814b61a718a902965eed26 (table test-table [id=4d926defb05d4dbe92c2db70158abc03]) successfully deleted
I20260811 07:07:39.396453 20108 ts_tablet_manager.cc:1918] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:39.396772 20108 log.cc:1196] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/73f558e27c814b61a718a902965eed26
I20260811 07:07:39.397513 20108 ts_tablet_manager.cc:1939] T 73f558e27c814b61a718a902965eed26 P 7346869e107044339f3229e7c9f9c8fc: Deleting consensus metadata
I20260811 07:07:39.399055 20107 ts_tablet_manager.cc:1918] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:39.399382 20107 log.cc:1196] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/73f558e27c814b61a718a902965eed26
I20260811 07:07:39.400146 20107 ts_tablet_manager.cc:1939] T 73f558e27c814b61a718a902965eed26 P 622cab8f2e744fcbb332c877b38502e2: Deleting consensus metadata
I20260811 07:07:39.400395 19510 catalog_manager.cc:4841] TS 7346869e107044339f3229e7c9f9c8fc (127.30.73.67:41643): tablet 73f558e27c814b61a718a902965eed26 (table test-table [id=4d926defb05d4dbe92c2db70158abc03]) successfully deleted
I20260811 07:07:39.402534 19509 catalog_manager.cc:4841] TS 622cab8f2e744fcbb332c877b38502e2 (127.30.73.65:38841): tablet 73f558e27c814b61a718a902965eed26 (table test-table [id=4d926defb05d4dbe92c2db70158abc03]) successfully deleted
I20260811 07:07:39.405345 20080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:39.361374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55400 (local address 127.30.73.65:38841)
0811 07:07:39.361667 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:39.361678 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:39.375546 (+ 13868us) server_negotiation.cc:407] Connection header received
0811 07:07:39.376310 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:39.376320 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:39.376473 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:39.376581 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:39.379209 (+ 2628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.380526 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.382823 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.383616 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.383732 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:39.395780 (+ 12048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:39.395801 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:39.395829 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:39.395918 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:39.401389 (+ 5471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:39.402638 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:39.402647 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:39.402650 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:39.402910 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:39.403365 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:39.403383 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:39.403386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:39.403952 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:39.404318 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:39.404649 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 07:07:39.404931 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:07:39.406296 19742 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:39.524883 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 19595
I20260811 07:07:39.553459 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 19755
Aug 11 07:07:39 dist-test-slave-69rg krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:07:39.572914 20077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:39.554582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54232 (local address 127.30.73.66:44033)
0811 07:07:39.554866 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:39.554874 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:39.554907 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:07:39.555079 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:39.555087 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:39.555190 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:39.555318 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:39.556786 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.557702 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.559461 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.559955 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.560073 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:39.565635 (+ 5562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:39.565657 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:39.565682 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:39.565732 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:39.569197 (+ 3465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:39.570213 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:39.570224 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:39.570227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:39.570396 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:39.570878 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:39.570882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:39.570885 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:39.571487 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:39.571807 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:39.572174 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 07:07:39.572400 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260811 07:07:39.573810 19900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:39.673609 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 19755
I20260811 07:07:39.699720 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 19915
Aug 11 07:07:39 dist-test-slave-69rg krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:07:39.718724 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:39.700786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39274 (local address 127.30.73.67:41643)
0811 07:07:39.701000 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:39.701005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:39.701027 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:07:39.701240 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:39.701246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:39.701352 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:39.701481 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:39.703295 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.704172 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.705641 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:39.706382 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:39.706551 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:39.711986 (+ 5435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:39.712006 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:39.712030 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:39.712073 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:39.715484 (+ 3411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:39.716291 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:39.716300 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:39.716303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:39.716465 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:39.716886 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:39.716891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:39.716894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:39.717328 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:39.717676 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:39.718037 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 07:07:39.718314 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:07:39.719466 20054 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:39.820106 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 19915
I20260811 07:07:39.849018 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 19485
I20260811 07:07:39.850562 19557 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:39.980289 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 19485
2026-08-11T07:07:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5511 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T07:07:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:40Z Disabled control of system clock
I20260811 07:07:40.120828 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44221
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:46233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:44221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:07:40.552181 20121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:40.552723 20121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:40.552920 20121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:40.561956 20121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:40.562180 20121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:40.562285 20121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:40.562405 20121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:40.562512 20121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:40.573252 20121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:46233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:44221
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:44221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:40.575268 20121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:40.577697 20121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:40.591687 20127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:40.591768 20128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:40.591790 20130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:40.593245 20121 server_base.cc:1034] running on GCE node
I20260811 07:07:40.594408 20121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:40.596415 20121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:40.597728 20121 hybrid_clock.cc:648] HybridClock initialized: now 1786432060597674 us; error 74 us; skew 500 ppm
I20260811 07:07:40.598290 20121 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:40.601622 20121 webserver.cc:460] Webserver started at http://127.30.73.126:32981/ using document root <none> and password file <none>
I20260811 07:07:40.602684 20121 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:40.602856 20121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:40.603286 20121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:40.607105 20121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "639165fc61224fe5ba44313e7ccb2057"
format_stamp: "Formatted at 2026-08-11 07:07:40 on dist-test-slave-69rg"
server_key: "d892bf089955dbe5a00da1294580ef8a"
server_key_iv: "54a2dc8309942c3ab61d2df5421bd556"
server_key_version: "encryptionkey@0"
I20260811 07:07:40.608096 20121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "639165fc61224fe5ba44313e7ccb2057"
format_stamp: "Formatted at 2026-08-11 07:07:40 on dist-test-slave-69rg"
server_key: "d892bf089955dbe5a00da1294580ef8a"
server_key_iv: "54a2dc8309942c3ab61d2df5421bd556"
server_key_version: "encryptionkey@0"
I20260811 07:07:40.615053 20121 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 07:07:40.619700 20136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:40.621495 20121 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:07:40.621762 20121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "639165fc61224fe5ba44313e7ccb2057"
format_stamp: "Formatted at 2026-08-11 07:07:40 on dist-test-slave-69rg"
server_key: "d892bf089955dbe5a00da1294580ef8a"
server_key_iv: "54a2dc8309942c3ab61d2df5421bd556"
server_key_version: "encryptionkey@0"
I20260811 07:07:40.622128 20121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:40.653949 20121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:40.655222 20121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:40.655622 20121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:40.680476 20202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:44221 every 8 connection(s)
I20260811 07:07:40.680480 20121 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:44221
I20260811 07:07:40.682549 20121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:40.687529 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 20121
I20260811 07:07:40.687778 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:07:40.688006 20203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:40.688504 31013 external_mini_cluster.cc:1428] Setting key f2b89522b37ff1cf8a278b036faac5a0
I20260811 07:07:40.704164 20203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057: Bootstrap starting.
I20260811 07:07:40.705720 20206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:40.691234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41432 (local address 127.30.73.126:44221)
0811 07:07:40.692583 (+ 1349us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:40.692597 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:40.692660 (+ 63us) server_negotiation.cc:407] Connection header received
0811 07:07:40.694695 (+ 2035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:40.694724 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:40.695340 (+ 616us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:40.695873 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:40.696655 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:40.698338 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:40.700073 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:40.700974 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:40.701258 (+ 284us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:40.702733 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:40.702743 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:40.702763 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:40.703485 (+ 722us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:40.703588 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:40.703614 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:40.703772 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:40.704030 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 07:07:40.704495 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":480,"threads_started":1}
I20260811 07:07:40.708756 20203 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:40.710254 20203 log.cc:824] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:40.713754 20203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057: No bootstrap required, opened a new log
I20260811 07:07:40.722556 20203 raft_consensus.cc:348] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639165fc61224fe5ba44313e7ccb2057" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44221 } }
I20260811 07:07:40.723060 20203 raft_consensus.cc:374] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:40.723182 20203 raft_consensus.cc:729] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 639165fc61224fe5ba44313e7ccb2057, State: Initialized, Role: FOLLOWER
I20260811 07:07:40.723955 20203 consensus_queue.cc:260] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639165fc61224fe5ba44313e7ccb2057" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44221 } }
I20260811 07:07:40.724277 20203 raft_consensus.cc:388] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:40.724448 20203 raft_consensus.cc:482] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:40.724653 20203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:40.727710 20203 raft_consensus.cc:504] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639165fc61224fe5ba44313e7ccb2057" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44221 } }
I20260811 07:07:40.728473 20203 leader_election.cc:302] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 639165fc61224fe5ba44313e7ccb2057; no voters:
I20260811 07:07:40.729240 20203 leader_election.cc:288] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:07:40.729532 20208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:40.730590 20208 raft_consensus.cc:686] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [term 1 LEADER]: Becoming Leader. State: Replica: 639165fc61224fe5ba44313e7ccb2057, State: Running, Role: LEADER
I20260811 07:07:40.731277 20208 consensus_queue.cc:237] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639165fc61224fe5ba44313e7ccb2057" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44221 } }
I20260811 07:07:40.732299 20203 sys_catalog.cc:564] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:40.735219 20212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 639165fc61224fe5ba44313e7ccb2057. Latest consensus state: current_term: 1 leader_uuid: "639165fc61224fe5ba44313e7ccb2057" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639165fc61224fe5ba44313e7ccb2057" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44221 } } }
I20260811 07:07:40.735296 20211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "639165fc61224fe5ba44313e7ccb2057" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639165fc61224fe5ba44313e7ccb2057" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 44221 } } }
I20260811 07:07:40.735795 20211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:40.735803 20212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:40.738334 20216 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:40.745524 20216 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:40.757907 20216 catalog_manager.cc:1347] Generated new cluster ID: 8190c0fd53a7479481e96b8cffe4565d
I20260811 07:07:40.758121 20216 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:40.780315 20216 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:07:40.782747 20216 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:40.795329 20216 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057: Generated new TSK 0
I20260811 07:07:40.796682 20216 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:07:40.806756 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44221
--builtin_ntp_servers=127.30.73.84:46233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:07:41.297794 20233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:41.298246 20233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:41.298404 20233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:41.305775 20233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:41.305950 20233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:41.306145 20233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:07:41.315594 20233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:46233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:41.317111 20233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:41.319355 20233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:41.335889 20240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:41.336256 20239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:41.336575 20242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:41.337316 20233 server_base.cc:1034] running on GCE node
I20260811 07:07:41.338179 20233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:41.339334 20233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:41.340610 20233 hybrid_clock.cc:648] HybridClock initialized: now 1786432061340530 us; error 71 us; skew 500 ppm
I20260811 07:07:41.341002 20233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:41.343545 20233 webserver.cc:460] Webserver started at http://127.30.73.65:38789/ using document root <none> and password file <none>
I20260811 07:07:41.344328 20233 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:41.344465 20233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:41.344805 20233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:41.347884 20233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "344665b4cef24d41b17f1818696d1e40"
format_stamp: "Formatted at 2026-08-11 07:07:41 on dist-test-slave-69rg"
server_key: "3f37dfa745115308d901d652fddf7ec2"
server_key_iv: "5ceeee9fb1e6d794f640f09912a86345"
server_key_version: "encryptionkey@0"
I20260811 07:07:41.348757 20233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "344665b4cef24d41b17f1818696d1e40"
format_stamp: "Formatted at 2026-08-11 07:07:41 on dist-test-slave-69rg"
server_key: "3f37dfa745115308d901d652fddf7ec2"
server_key_iv: "5ceeee9fb1e6d794f640f09912a86345"
server_key_version: "encryptionkey@0"
I20260811 07:07:41.354460 20233 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 07:07:41.358304 20248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:41.359925 20233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:07:41.360116 20233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "344665b4cef24d41b17f1818696d1e40"
format_stamp: "Formatted at 2026-08-11 07:07:41 on dist-test-slave-69rg"
server_key: "3f37dfa745115308d901d652fddf7ec2"
server_key_iv: "5ceeee9fb1e6d794f640f09912a86345"
server_key_version: "encryptionkey@0"
I20260811 07:07:41.360350 20233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:41.383697 20233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:41.384642 20233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:41.384975 20233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:41.386201 20233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:41.387880 20233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:41.387971 20233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:41.388136 20233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:41.388218 20233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:41.427801 20233 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:38711
I20260811 07:07:41.427855 20375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:38711 every 8 connection(s)
I20260811 07:07:41.429205 20233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:07:41.434465 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 20233
I20260811 07:07:41.434664 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:07:41.435312 31013 external_mini_cluster.cc:1428] Setting key 151df58d6f3b7922f32bfc78d7f554e8
I20260811 07:07:41.438885 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44221
--builtin_ntp_servers=127.30.73.84:46233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:07:41.447448 20381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:41.432162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:55139 (local address 127.30.73.126:44221)
0811 07:07:41.432720 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:41.432727 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:41.436137 (+ 3410us) server_negotiation.cc:407] Connection header received
0811 07:07:41.437322 (+ 1185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:41.437329 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:41.437433 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:41.437582 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:41.439398 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:41.440679 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:41.443531 (+ 2852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:41.444257 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:41.444399 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:41.446348 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:41.446357 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:41.446365 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:41.446393 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:41.446450 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:41.446469 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:41.446566 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:41.446855 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 07:07:41.446979 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":290,"threads_started":1}
I20260811 07:07:41.448943 20382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:41.433088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44221 (local address 127.30.73.65:55139)
0811 07:07:41.434708 (+ 1620us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:41.434770 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:41.437038 (+ 2268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:41.437921 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:41.437936 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:41.438107 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:41.439112 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:41.439143 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:41.440876 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:41.440884 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:41.443338 (+ 2454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:41.443360 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:41.444530 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:41.444539 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:41.444915 (+ 376us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:41.445865 (+ 950us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:07:41.445871 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:41.445935 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:07:41.446062 (+ 127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:41.446582 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:41.446593 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:41.446601 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:07:41.446806 (+ 205us) client_negotiation.cc:240] Negotiation successful
0811 07:07:41.447311 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":997,"thread_start_us":747,"threads_started":1}
I20260811 07:07:41.451144 20376 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44221
I20260811 07:07:41.451505 20376 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:41.452590 20376 heartbeater.cc:511] Master 127.30.73.126:44221 requested a full tablet report, sending...
I20260811 07:07:41.455433 20158 ts_manager.cc:194] Registered new tserver with Master: 344665b4cef24d41b17f1818696d1e40 (127.30.73.65:38711)
I20260811 07:07:41.458036 20158 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.65:55139
W20260811 07:07:41.820768 20383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:41.821189 20383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:41.821369 20383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:41.829059 20383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:41.829229 20383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:41.829404 20383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:07:41.839138 20383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:46233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:41.840667 20383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:41.842597 20383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:41.856667 20388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:41.856688 20391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:41.856824 20389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:41.857561 20383 server_base.cc:1034] running on GCE node
I20260811 07:07:41.858302 20383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:41.859395 20383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:41.860617 20383 hybrid_clock.cc:648] HybridClock initialized: now 1786432061860581 us; error 34 us; skew 500 ppm
I20260811 07:07:41.860949 20383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:41.870713 20383 webserver.cc:460] Webserver started at http://127.30.73.66:40613/ using document root <none> and password file <none>
I20260811 07:07:41.871451 20383 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:41.871549 20383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:41.871840 20383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:41.874928 20383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "847dadc89d6e4e9387b0d4a4c690b6b5"
format_stamp: "Formatted at 2026-08-11 07:07:41 on dist-test-slave-69rg"
server_key: "68279022f43627b94f56a10bf40e196f"
server_key_iv: "9528be0060914cfc2d01eba2883e2e3b"
server_key_version: "encryptionkey@0"
I20260811 07:07:41.875700 20383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "847dadc89d6e4e9387b0d4a4c690b6b5"
format_stamp: "Formatted at 2026-08-11 07:07:41 on dist-test-slave-69rg"
server_key: "68279022f43627b94f56a10bf40e196f"
server_key_iv: "9528be0060914cfc2d01eba2883e2e3b"
server_key_version: "encryptionkey@0"
I20260811 07:07:41.881278 20383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:07:41.885193 20398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:41.886679 20383 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:07:41.886832 20383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "847dadc89d6e4e9387b0d4a4c690b6b5"
format_stamp: "Formatted at 2026-08-11 07:07:41 on dist-test-slave-69rg"
server_key: "68279022f43627b94f56a10bf40e196f"
server_key_iv: "9528be0060914cfc2d01eba2883e2e3b"
server_key_version: "encryptionkey@0"
I20260811 07:07:41.887018 20383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:41.903712 20383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:41.904670 20383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:41.905022 20383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:41.906165 20383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:41.907707 20383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:41.907809 20383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:41.907948 20383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:41.908052 20383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:41.946595 20383 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:35497
I20260811 07:07:41.946674 20526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:35497 every 8 connection(s)
I20260811 07:07:41.947999 20383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:07:41.955418 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 20383
I20260811 07:07:41.955644 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:07:41.956254 31013 external_mini_cluster.cc:1428] Setting key 420dba08de1c0d93657c8b21de243345
I20260811 07:07:41.959789 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44221
--builtin_ntp_servers=127.30.73.84:46233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:07:41.962954 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:41.951051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:36649 (local address 127.30.73.126:44221)
0811 07:07:41.951561 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:41.951568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:41.952812 (+ 1244us) server_negotiation.cc:407] Connection header received
0811 07:07:41.954802 (+ 1990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:41.954807 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:41.954889 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:41.954989 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:41.956581 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:41.957510 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:41.959731 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:41.960253 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:41.960363 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:41.962121 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:41.962126 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:41.962130 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:41.962150 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:41.962213 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:41.962228 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:41.962311 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:41.962596 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 07:07:41.962684 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":229,"threads_started":1}
I20260811 07:07:41.964444 20531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:41.951687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44221 (local address 127.30.73.66:36649)
0811 07:07:41.952657 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:41.952698 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:41.954538 (+ 1840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:41.955348 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:41.955363 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:41.955490 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:41.956385 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:41.956416 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:41.957665 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:41.957671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:41.959573 (+ 1902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:41.959591 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:41.960491 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:41.960502 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:41.960844 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:41.961712 (+ 868us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:07:41.961718 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:41.961773 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:07:41.961908 (+ 135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:41.962337 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:41.962351 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:41.962362 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:07:41.962543 (+ 181us) client_negotiation.cc:240] Negotiation successful
0811 07:07:41.962982 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":296,"threads_started":1}
I20260811 07:07:41.966006 20527 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44221
I20260811 07:07:41.966355 20527 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:41.967308 20527 heartbeater.cc:511] Master 127.30.73.126:44221 requested a full tablet report, sending...
I20260811 07:07:41.969116 20158 ts_manager.cc:194] Registered new tserver with Master: 847dadc89d6e4e9387b0d4a4c690b6b5 (127.30.73.66:35497)
I20260811 07:07:41.970414 20158 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.66:36649
W20260811 07:07:42.347700 20532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:42.348140 20532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:42.348315 20532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:42.356487 20532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:42.356669 20532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:42.356868 20532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:07:42.368216 20532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:46233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:44221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:42.370160 20532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:42.372956 20532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:42.392311 20539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:42.392565 20538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:42.393342 20541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:42.393976 20532 server_base.cc:1034] running on GCE node
I20260811 07:07:42.394799 20532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:42.396302 20532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:42.397581 20532 hybrid_clock.cc:648] HybridClock initialized: now 1786432062397505 us; error 45 us; skew 500 ppm
I20260811 07:07:42.398118 20532 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:42.401299 20532 webserver.cc:460] Webserver started at http://127.30.73.67:39395/ using document root <none> and password file <none>
I20260811 07:07:42.402375 20532 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:42.402493 20532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:42.402966 20532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:42.406934 20532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "2868d5b939914bcc8e0d8156bddf1528"
format_stamp: "Formatted at 2026-08-11 07:07:42 on dist-test-slave-69rg"
server_key: "33b438f3303d1ec3c2b862a1a04f442f"
server_key_iv: "51b5af8178a5f22e7ca798d3a9f378de"
server_key_version: "encryptionkey@0"
I20260811 07:07:42.407989 20532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "2868d5b939914bcc8e0d8156bddf1528"
format_stamp: "Formatted at 2026-08-11 07:07:42 on dist-test-slave-69rg"
server_key: "33b438f3303d1ec3c2b862a1a04f442f"
server_key_iv: "51b5af8178a5f22e7ca798d3a9f378de"
server_key_version: "encryptionkey@0"
I20260811 07:07:42.414511 20532 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:07:42.418774 20547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:42.420370 20532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260811 07:07:42.420588 20532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "2868d5b939914bcc8e0d8156bddf1528"
format_stamp: "Formatted at 2026-08-11 07:07:42 on dist-test-slave-69rg"
server_key: "33b438f3303d1ec3c2b862a1a04f442f"
server_key_iv: "51b5af8178a5f22e7ca798d3a9f378de"
server_key_version: "encryptionkey@0"
I20260811 07:07:42.420850 20532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:42.462600 20376 heartbeater.cc:503] Master 127.30.73.126:44221 was elected leader, sending a full tablet report...
I20260811 07:07:42.470544 20532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:42.471714 20532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:42.472141 20532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:42.473526 20532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:42.475557 20532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:42.475703 20532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:42.475924 20532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:42.476040 20532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:42.517385 20532 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:46511
I20260811 07:07:42.517475 20683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:46511 every 8 connection(s)
I20260811 07:07:42.519272 20532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:07:42.528182 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 20532
I20260811 07:07:42.528400 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:07:42.528923 31013 external_mini_cluster.cc:1428] Setting key 199e12d91a1734e9e892488b8a656e05
I20260811 07:07:42.536026 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.522662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:39493 (local address 127.30.73.126:44221)
0811 07:07:42.523218 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:42.523224 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:42.524783 (+ 1559us) server_negotiation.cc:407] Connection header received
0811 07:07:42.527208 (+ 2425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:42.527214 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:42.527339 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:42.527503 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:42.529014 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.530281 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.532477 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.532978 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.533135 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.534947 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:42.534967 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:42.534971 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:42.534994 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:42.535048 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:42.535063 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:42.535180 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:42.535450 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 07:07:42.535583 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":306,"threads_started":1}
I20260811 07:07:42.537355 20687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.523461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:44221 (local address 127.30.73.67:39493)
0811 07:07:42.524583 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:42.524643 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:42.526876 (+ 2233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:42.527815 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:42.527852 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:42.527985 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:42.528803 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.528824 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.530575 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.530579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.532309 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.532329 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.533247 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.533258 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.533601 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.534538 (+ 937us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:07:42.534541 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:42.534592 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:07:42.534695 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:42.535180 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:42.535196 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:42.535209 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 07:07:42.535436 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 07:07:42.535992 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":333,"threads_started":1}
I20260811 07:07:42.539028 20684 heartbeater.cc:347] Connected to a master server at 127.30.73.126:44221
I20260811 07:07:42.539409 20684 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:42.540546 20684 heartbeater.cc:511] Master 127.30.73.126:44221 requested a full tablet report, sending...
I20260811 07:07:42.542418 20158 ts_manager.cc:194] Registered new tserver with Master: 2868d5b939914bcc8e0d8156bddf1528 (127.30.73.67:46511)
I20260811 07:07:42.543596 20158 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.67:39493
I20260811 07:07:42.545316 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:07:42.557451 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.550136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41446 (local address 127.30.73.126:44221)
0811 07:07:42.550375 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:42.550385 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:42.550917 (+ 532us) server_negotiation.cc:407] Connection header received
0811 07:07:42.551073 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:42.551077 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:42.551151 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:42.551239 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:42.551966 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.552955 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.554626 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.555124 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.555231 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.556552 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:42.556557 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:42.556560 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:42.556582 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:42.556620 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:42.556633 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:42.556758 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:42.556951 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 07:07:42.557042 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:07:42.562290 20158 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41446:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:07:42.570564 20158 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:07:42.608260 20699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.586913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60996 (local address 127.30.73.65:38711)
0811 07:07:42.599845 (+ 12932us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:42.599854 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:42.599889 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:07:42.600148 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:42.600157 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:42.600405 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:42.600626 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:42.601285 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.602851 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.605649 (+ 2798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.606789 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.606984 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.607346 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:42.607593 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 07:07:42.607817 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12692,"thread_start_us":12506,"threads_started":1}
I20260811 07:07:42.608299 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.586813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38711 (local address 127.0.0.1:60996)
0811 07:07:42.587869 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:42.587953 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:42.588206 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:42.600648 (+ 12442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:42.600653 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:42.600681 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:42.601098 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.601109 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.603062 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.603070 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.605425 (+ 2355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.605444 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.607019 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.607025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.607249 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.607318 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 07:07:42.607536 (+ 218us) client_negotiation.cc:240] Negotiation successful
0811 07:07:42.607817 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":26,"thread_start_us":436,"threads_started":1}
I20260811 07:07:42.608729 20701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.588259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:35497 (local address 127.0.0.1:55724)
0811 07:07:42.598407 (+ 10148us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:42.598429 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:42.598565 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:42.599352 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:42.599366 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:42.599462 (+ 96us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:42.599905 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.600015 (+ 110us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.602425 (+ 2410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.602430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.604824 (+ 2394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.604841 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.607603 (+ 2762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.607613 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.607952 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.608042 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 07:07:42.608132 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 07:07:42.608310 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10013,"mutex_wait_us":70,"thread_start_us":10830,"threads_started":1}
I20260811 07:07:42.608886 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.588688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40844 (local address 127.30.73.67:46511)
0811 07:07:42.597937 (+ 9249us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:42.597948 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:42.598001 (+ 53us) server_negotiation.cc:407] Connection header received
0811 07:07:42.598173 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:42.598187 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:42.598560 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:42.598811 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:42.599852 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.601371 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.605380 (+ 4009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.606905 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.607052 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.607351 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:42.608264 (+ 913us) server_negotiation.cc:299] Negotiation successful
0811 07:07:42.608457 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9015,"thread_start_us":8827,"threads_started":1}
I20260811 07:07:42.609709 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.589435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55724 (local address 127.30.73.66:35497)
0811 07:07:42.596854 (+ 7419us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:42.596868 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:42.598716 (+ 1848us) server_negotiation.cc:407] Connection header received
0811 07:07:42.598851 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:42.598857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:42.599105 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:42.600271 (+ 1166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:42.600606 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.602257 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.605099 (+ 2842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.606843 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.607023 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.607310 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:42.608999 (+ 1689us) server_negotiation.cc:299] Negotiation successful
0811 07:07:42.609293 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7222,"thread_start_us":7055,"threads_started":1}
I20260811 07:07:42.609946 20700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.587278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:46511 (local address 127.0.0.1:40844)
0811 07:07:42.590428 (+ 3150us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:42.590452 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:42.590620 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:42.598855 (+ 8235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:42.598867 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:42.598915 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:42.599591 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.599607 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.601521 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.601530 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.605144 (+ 3614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.605155 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.607603 (+ 2448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.607613 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.607952 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.608045 (+ 93us) client_negotiation.cc:769] Sending connection context
0811 07:07:42.608132 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 07:07:42.609533 (+ 1401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2913,"mutex_wait_us":1045,"thread_start_us":2734,"threads_started":1}
I20260811 07:07:42.614076 20607 tablet_service.cc:1467] Processing CreateTablet for tablet f5d189fb01ee4302be6bd5d06e9ac0ea (DEFAULT_TABLE table=test-table [id=f0c0e52e5c4d40a88230245c90f1444d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:42.614080 20454 tablet_service.cc:1467] Processing CreateTablet for tablet f5d189fb01ee4302be6bd5d06e9ac0ea (DEFAULT_TABLE table=test-table [id=f0c0e52e5c4d40a88230245c90f1444d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:42.614080 20302 tablet_service.cc:1467] Processing CreateTablet for tablet f5d189fb01ee4302be6bd5d06e9ac0ea (DEFAULT_TABLE table=test-table [id=f0c0e52e5c4d40a88230245c90f1444d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:42.615778 20607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5d189fb01ee4302be6bd5d06e9ac0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:42.615784 20302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5d189fb01ee4302be6bd5d06e9ac0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:42.615805 20454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5d189fb01ee4302be6bd5d06e9ac0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:42.631587 20705 tablet_bootstrap.cc:492] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: Bootstrap starting.
I20260811 07:07:42.635170 20707 tablet_bootstrap.cc:492] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40: Bootstrap starting.
I20260811 07:07:42.636664 20705 tablet_bootstrap.cc:654] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:42.638409 20705 log.cc:824] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:42.639762 20707 tablet_bootstrap.cc:654] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:42.640878 20706 tablet_bootstrap.cc:492] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: Bootstrap starting.
I20260811 07:07:42.641853 20707 log.cc:824] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:42.645298 20706 tablet_bootstrap.cc:654] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:42.646644 20706 log.cc:824] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:42.646869 20705 tablet_bootstrap.cc:492] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: No bootstrap required, opened a new log
I20260811 07:07:42.646865 20707 tablet_bootstrap.cc:492] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40: No bootstrap required, opened a new log
I20260811 07:07:42.647221 20707 ts_tablet_manager.cc:1397] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260811 07:07:42.647221 20705 ts_tablet_manager.cc:1397] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.008s
I20260811 07:07:42.656644 20706 tablet_bootstrap.cc:492] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: No bootstrap required, opened a new log
I20260811 07:07:42.657058 20706 ts_tablet_manager.cc:1397] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.004s
I20260811 07:07:42.659488 20707 raft_consensus.cc:348] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } }
I20260811 07:07:42.659719 20705 raft_consensus.cc:348] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } }
I20260811 07:07:42.660106 20707 raft_consensus.cc:374] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:42.660214 20705 raft_consensus.cc:374] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:42.660264 20707 raft_consensus.cc:729] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344665b4cef24d41b17f1818696d1e40, State: Initialized, Role: FOLLOWER
I20260811 07:07:42.660326 20705 raft_consensus.cc:729] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2868d5b939914bcc8e0d8156bddf1528, State: Initialized, Role: FOLLOWER
I20260811 07:07:42.661142 20705 consensus_queue.cc:260] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } }
I20260811 07:07:42.661120 20707 consensus_queue.cc:260] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } }
I20260811 07:07:42.667412 20706 raft_consensus.cc:348] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } }
I20260811 07:07:42.667914 20706 raft_consensus.cc:374] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:42.668073 20706 raft_consensus.cc:729] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847dadc89d6e4e9387b0d4a4c690b6b5, State: Initialized, Role: FOLLOWER
I20260811 07:07:42.668936 20684 heartbeater.cc:503] Master 127.30.73.126:44221 was elected leader, sending a full tablet report...
I20260811 07:07:42.668919 20706 consensus_queue.cc:260] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } }
I20260811 07:07:42.670295 20705 ts_tablet_manager.cc:1428] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: Time spent starting tablet: real 0.023s user 0.014s sys 0.008s
I20260811 07:07:42.671146 20707 ts_tablet_manager.cc:1428] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40: Time spent starting tablet: real 0.024s user 0.017s sys 0.005s
I20260811 07:07:42.673089 20527 heartbeater.cc:503] Master 127.30.73.126:44221 was elected leader, sending a full tablet report...
I20260811 07:07:42.673777 20706 ts_tablet_manager.cc:1428] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: Time spent starting tablet: real 0.017s user 0.014s sys 0.003s
W20260811 07:07:42.682129 20379 tablet.cc:2369] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:07:42.700608 20528 tablet.cc:2369] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:07:42.771656 20685 tablet.cc:2369] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:07:42.804076 20713 raft_consensus.cc:482] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:42.804557 20713 raft_consensus.cc:504] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } }
I20260811 07:07:42.806864 20713 leader_election.cc:288] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847dadc89d6e4e9387b0d4a4c690b6b5 (127.30.73.66:35497), 2868d5b939914bcc8e0d8156bddf1528 (127.30.73.67:46511)
I20260811 07:07:42.814280 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.807781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:42005 (local address 127.30.73.67:46511)
0811 07:07:42.808131 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:42.808141 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:42.808486 (+ 345us) server_negotiation.cc:407] Connection header received
0811 07:07:42.808776 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:42.808781 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:42.808857 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:42.808972 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:42.809588 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.810428 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.812381 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.813234 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.813432 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.813519 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:42.813808 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 07:07:42.813984 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260811 07:07:42.814383 20716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.807295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:46511 (local address 127.30.73.65:42005)
0811 07:07:42.808342 (+ 1047us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:42.808360 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:42.808593 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:42.808999 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:42.809004 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:42.809034 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:42.809430 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.809439 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.810562 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.810569 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.812166 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.812179 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.813451 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.813457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.813632 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.813659 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:07:42.813773 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 07:07:42.813943 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"spinlock_wait_cycles":10112,"thread_start_us":1075,"threads_started":1}
I20260811 07:07:42.814672 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.807426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:40799 (local address 127.30.73.66:35497)
0811 07:07:42.807732 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:42.807743 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:42.809053 (+ 1310us) server_negotiation.cc:407] Connection header received
0811 07:07:42.809322 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:42.809327 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:42.809429 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:42.809546 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:42.810224 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.810947 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.812812 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.813620 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.813800 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.813922 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:42.814217 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 07:07:42.814362 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 07:07:42.814795 20715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.807377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:35497 (local address 127.30.73.65:40799)
0811 07:07:42.808754 (+ 1377us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:42.808775 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:42.809137 (+ 362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:42.809564 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:42.809569 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:42.809591 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:42.810044 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.810055 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.811103 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.811109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.812621 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:42.812633 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.813857 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.813865 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:42.814042 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.814075 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:07:42.814184 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 07:07:42.814312 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1266,"mutex_wait_us":1,"thread_start_us":548,"threads_started":1}
I20260811 07:07:42.815924 20632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5d189fb01ee4302be6bd5d06e9ac0ea" candidate_uuid: "344665b4cef24d41b17f1818696d1e40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2868d5b939914bcc8e0d8156bddf1528" is_pre_election: true
I20260811 07:07:42.815970 20477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5d189fb01ee4302be6bd5d06e9ac0ea" candidate_uuid: "344665b4cef24d41b17f1818696d1e40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" is_pre_election: true
I20260811 07:07:42.816597 20632 raft_consensus.cc:2454] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344665b4cef24d41b17f1818696d1e40 in term 0.
I20260811 07:07:42.816598 20477 raft_consensus.cc:2454] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344665b4cef24d41b17f1818696d1e40 in term 0.
I20260811 07:07:42.817402 20252 leader_election.cc:302] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2868d5b939914bcc8e0d8156bddf1528, 344665b4cef24d41b17f1818696d1e40, 847dadc89d6e4e9387b0d4a4c690b6b5; no voters:
I20260811 07:07:42.817914 20713 raft_consensus.cc:2781] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:07:42.818084 20713 raft_consensus.cc:482] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:07:42.818225 20713 raft_consensus.cc:3037] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:42.820823 20713 raft_consensus.cc:504] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } }
I20260811 07:07:42.821596 20713 leader_election.cc:288] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [CANDIDATE]: Term 1 election: Requested vote from peers 847dadc89d6e4e9387b0d4a4c690b6b5 (127.30.73.66:35497), 2868d5b939914bcc8e0d8156bddf1528 (127.30.73.67:46511)
I20260811 07:07:42.822185 20477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5d189fb01ee4302be6bd5d06e9ac0ea" candidate_uuid: "344665b4cef24d41b17f1818696d1e40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5"
I20260811 07:07:42.822184 20632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5d189fb01ee4302be6bd5d06e9ac0ea" candidate_uuid: "344665b4cef24d41b17f1818696d1e40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2868d5b939914bcc8e0d8156bddf1528"
I20260811 07:07:42.822446 20477 raft_consensus.cc:3037] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:42.822453 20632 raft_consensus.cc:3037] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:42.826678 20477 raft_consensus.cc:2454] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344665b4cef24d41b17f1818696d1e40 in term 1.
I20260811 07:07:42.826653 20632 raft_consensus.cc:2454] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344665b4cef24d41b17f1818696d1e40 in term 1.
I20260811 07:07:42.827301 20252 leader_election.cc:302] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344665b4cef24d41b17f1818696d1e40, 847dadc89d6e4e9387b0d4a4c690b6b5; no voters:
I20260811 07:07:42.827766 20713 raft_consensus.cc:2781] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:42.828411 20713 raft_consensus.cc:686] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [term 1 LEADER]: Becoming Leader. State: Replica: 344665b4cef24d41b17f1818696d1e40, State: Running, Role: LEADER
I20260811 07:07:42.829062 20713 consensus_queue.cc:237] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } }
I20260811 07:07:42.835214 20156 catalog_manager.cc:5495] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 344665b4cef24d41b17f1818696d1e40 (127.30.73.65). New cstate: current_term: 1 leader_uuid: "344665b4cef24d41b17f1818696d1e40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "344665b4cef24d41b17f1818696d1e40" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 } health_report { overall_health: UNKNOWN } } }
I20260811 07:07:42.907230 20699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.900912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32770 (local address 127.30.73.65:38711)
0811 07:07:42.901158 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:42.901164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:42.901183 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:07:42.901293 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:42.901298 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:42.901430 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:42.901591 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:07:42.902115 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.902941 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.904657 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.905136 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.905264 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.905935 (+ 671us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:07:42.906641 (+ 706us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:07:42.906800 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:42.906929 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 07:07:42.906980 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 07:07:42.918923 20632 raft_consensus.cc:1261] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [term 1 FOLLOWER]: Refusing update from remote peer 344665b4cef24d41b17f1818696d1e40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:42.918915 20477 raft_consensus.cc:1261] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [term 1 FOLLOWER]: Refusing update from remote peer 344665b4cef24d41b17f1818696d1e40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:42.920252 20717 consensus_queue.cc:1035] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2868d5b939914bcc8e0d8156bddf1528" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 46511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:42.920707 20713 consensus_queue.cc:1035] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847dadc89d6e4e9387b0d4a4c690b6b5" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:42.964622 20156 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41446:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:42.965042 20156 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41446:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:42.969777 20156 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 639165fc61224fe5ba44313e7ccb2057: Sending DeleteTablet for 3 replicas of tablet f5d189fb01ee4302be6bd5d06e9ac0ea
I20260811 07:07:42.971539 20454 tablet_service.cc:1514] Processing DeleteTablet for tablet f5d189fb01ee4302be6bd5d06e9ac0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:42 UTC) from {username='slave'} at 127.0.0.1:55724
I20260811 07:07:42.971487 20607 tablet_service.cc:1514] Processing DeleteTablet for tablet f5d189fb01ee4302be6bd5d06e9ac0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:42 UTC) from {username='slave'} at 127.0.0.1:40844
I20260811 07:07:42.972959 20302 tablet_service.cc:1514] Processing DeleteTablet for tablet f5d189fb01ee4302be6bd5d06e9ac0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:42 UTC) from {username='slave'} at 127.0.0.1:60996
I20260811 07:07:42.978420 20733 tablet_replica.cc:330] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: stopping tablet replica
I20260811 07:07:42.978994 20733 raft_consensus.cc:2229] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:42.979689 20733 raft_consensus.cc:2258] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:42.979803 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 20233
I20260811 07:07:42.984490 20733 ts_tablet_manager.cc:1905] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:42.992159 20732 tablet_replica.cc:330] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: stopping tablet replica
I20260811 07:07:42.992280 20699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:42.981506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32774 (local address 127.30.73.65:38711)
0811 07:07:42.981763 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:42.981771 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:42.982491 (+ 720us) server_negotiation.cc:407] Connection header received
0811 07:07:42.982862 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:42.982870 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:42.983022 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:42.983114 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:42.984062 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.985269 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.987273 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:42.988000 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:42.988102 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:42.989976 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:42.989991 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:42.990015 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:42.991057 (+ 1042us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:42.991135 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:42.991164 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:42.991253 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:42.991609 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:07:42.991761 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 07:07:42.992830 20732 raft_consensus.cc:2229] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:42.993607 20732 raft_consensus.cc:2258] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:42.994071 20370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:42.996564 20732 ts_tablet_manager.cc:1905] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:42.997959 20733 ts_tablet_manager.cc:1918] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:42.998309 20733 log.cc:1196] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/f5d189fb01ee4302be6bd5d06e9ac0ea
I20260811 07:07:42.999101 20733 ts_tablet_manager.cc:1939] T f5d189fb01ee4302be6bd5d06e9ac0ea P 847dadc89d6e4e9387b0d4a4c690b6b5: Deleting consensus metadata
I20260811 07:07:43.002569 20141 catalog_manager.cc:4841] TS 847dadc89d6e4e9387b0d4a4c690b6b5 (127.30.73.66:35497): tablet f5d189fb01ee4302be6bd5d06e9ac0ea (table test-table [id=f0c0e52e5c4d40a88230245c90f1444d]) successfully deleted
I20260811 07:07:43.005442 20732 ts_tablet_manager.cc:1918] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:43.005838 20732 log.cc:1196] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/f5d189fb01ee4302be6bd5d06e9ac0ea
I20260811 07:07:43.006541 20732 ts_tablet_manager.cc:1939] T f5d189fb01ee4302be6bd5d06e9ac0ea P 2868d5b939914bcc8e0d8156bddf1528: Deleting consensus metadata
I20260811 07:07:43.009160 20139 catalog_manager.cc:4841] TS 2868d5b939914bcc8e0d8156bddf1528 (127.30.73.67:46511): tablet f5d189fb01ee4302be6bd5d06e9ac0ea (table test-table [id=f0c0e52e5c4d40a88230245c90f1444d]) successfully deleted
I20260811 07:07:43.115896 20734 tablet_replica.cc:330] T f5d189fb01ee4302be6bd5d06e9ac0ea P 344665b4cef24d41b17f1818696d1e40: stopping tablet replica
I20260811 07:07:43.116308 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 20233
I20260811 07:07:43.146380 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 20383
W20260811 07:07:43.146251 20141 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.73.65:38711 (error 108)
I20260811 07:07:43.148918 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.147997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38711 (local address 127.0.0.1:32784)
0811 07:07:43.148507 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:43.148687 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":246,"threads_started":1}
W20260811 07:07:43.149230 20141 catalog_manager.cc:4584] TS 344665b4cef24d41b17f1818696d1e40 (127.30.73.65:38711): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f5d189fb01ee4302be6bd5d06e9ac0ea: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38711: connect: Connection refused (error 111)
I20260811 07:07:43.155395 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.147492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55726 (local address 127.30.73.66:35497)
0811 07:07:43.147749 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:43.147758 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:43.147844 (+ 86us) server_negotiation.cc:407] Connection header received
0811 07:07:43.148106 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:43.148131 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:43.148291 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:43.148420 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:43.148992 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:43.150041 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:43.151482 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:43.151973 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:43.152082 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:43.153460 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:43.153470 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:43.153491 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:43.154481 (+ 990us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:43.154553 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:43.154579 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:43.154690 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:43.154931 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 07:07:43.155062 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260811 07:07:43.156322 20521 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:43.203357 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.202674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38711 (local address 127.0.0.1:32796)
0811 07:07:43.202983 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:43.203121 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260811 07:07:43.204735 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.204266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38711 (local address 127.0.0.1:32810)
0811 07:07:43.204457 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:43.204549 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 07:07:43.259112 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 20383
I20260811 07:07:43.266038 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.265249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38711 (local address 127.0.0.1:32818)
0811 07:07:43.265575 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:43.265726 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 07:07:43.267534 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.266994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38711 (local address 127.0.0.1:32820)
0811 07:07:43.267202 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:43.267312 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 07:07:43.287475 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 20532
I20260811 07:07:43.295776 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.288524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40854 (local address 127.30.73.67:46511)
0811 07:07:43.288778 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:43.288785 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:43.288810 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:07:43.288931 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:43.288936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:43.289051 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:43.289174 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:43.289665 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:43.290530 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:43.291963 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:43.292404 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:43.292563 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:43.293796 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:43.293807 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:43.294034 (+ 227us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:43.294833 (+ 799us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:43.294902 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:43.294929 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:43.295074 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:43.295226 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 07:07:43.295365 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 07:07:43.296681 20678 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:43.349025 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.348335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38711 (local address 127.0.0.1:32836)
0811 07:07:43.348668 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:43.348796 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260811 07:07:43.350647 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.350073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38711 (local address 127.0.0.1:32838)
0811 07:07:43.350344 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:43.350473 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
I20260811 07:07:43.405251 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 20532
I20260811 07:07:43.434342 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 20121
I20260811 07:07:43.435891 20197 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:43.564198 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:43.562377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38711 (local address 127.0.0.1:32840)
0811 07:07:43.563678 (+ 1301us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:43.563851 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.65:38711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":768}
I20260811 07:07:43.564451 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 20121
2026-08-11T07:07:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3567 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:07:43 dist-test-slave-69rg krb5kdc[20744](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:07:43 dist-test-slave-69rg krb5kdc[20744](info): set up 2 sockets
Aug 11 07:07:43 dist-test-slave-69rg krb5kdc[20744](info): commencing operation
krb5kdc: starting...
W20260811 07:07:44.844762 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.000s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:07:45 dist-test-slave-69rg krb5kdc[20744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:07:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:07:45.202056 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:41157
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:41157
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:45.612228 20759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:45.612703 20759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:45.612880 20759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:45.620908 20759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:45.621102 20759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:45.621222 20759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:45.621335 20759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:45.621419 20759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:45.632660 20759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:41157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:41157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:45.634506 20759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:45.636147 20759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:45.650704 20764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:45.650615 20768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:45.650682 20766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:45.651767 20759 server_base.cc:1034] running on GCE node
I20260811 07:07:45.652719 20759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:45.654549 20759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:45.655803 20759 hybrid_clock.cc:648] HybridClock initialized: now 1786432065655733 us; error 63 us; skew 500 ppm
I20260811 07:07:45.656215 20759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:45 dist-test-slave-69rg krb5kdc[20744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432065, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:45.659987 20759 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:07:45.661985 20759 webserver.cc:460] Webserver started at http://127.30.73.126:39485/ using document root <none> and password file <none>
I20260811 07:07:45.662811 20759 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:45.662925 20759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:45.663221 20759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:45.666806 20759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "14f71898e5ab4325b5b6c966c0b4bdb1"
format_stamp: "Formatted at 2026-08-11 07:07:45 on dist-test-slave-69rg"
server_key: "88e09c67c9048aec82b59865e309e42d"
server_key_iv: "4988525a07ff9ad6065d38a83bd58fa9"
server_key_version: "encryptionkey@0"
I20260811 07:07:45.667641 20759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "14f71898e5ab4325b5b6c966c0b4bdb1"
format_stamp: "Formatted at 2026-08-11 07:07:45 on dist-test-slave-69rg"
server_key: "88e09c67c9048aec82b59865e309e42d"
server_key_iv: "4988525a07ff9ad6065d38a83bd58fa9"
server_key_version: "encryptionkey@0"
I20260811 07:07:45.673959 20759 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 07:07:45.678396 20776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:45.680203 20759 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260811 07:07:45.680444 20759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "14f71898e5ab4325b5b6c966c0b4bdb1"
format_stamp: "Formatted at 2026-08-11 07:07:45 on dist-test-slave-69rg"
server_key: "88e09c67c9048aec82b59865e309e42d"
server_key_iv: "4988525a07ff9ad6065d38a83bd58fa9"
server_key_version: "encryptionkey@0"
I20260811 07:07:45.680708 20759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:45.703753 20759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:45.709604 20759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:45.710035 20759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:45.734211 20759 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:41157
I20260811 07:07:45.734257 20834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:41157 every 8 connection(s)
I20260811 07:07:45.736078 20759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:45.739459 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 20759
I20260811 07:07:45.739744 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:07:45.740459 31013 external_mini_cluster.cc:1428] Setting key a2cab64de32ea0c6a89fb24fc923ce07
I20260811 07:07:45.742412 20835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:07:45 dist-test-slave-69rg krb5kdc[20744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:45.762243 20835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1: Bootstrap starting.
I20260811 07:07:45.767066 20835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:45.768759 20835 log.cc:824] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:45.771631 20838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:45.743028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57208 (local address 127.30.73.126:41157)
0811 07:07:45.744003 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:45.744018 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:45.744069 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:07:45.746043 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:45.746073 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:45.746560 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:45.746981 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:45.749664 (+ 2683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:45.751543 (+ 1879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:45.754180 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:45.755185 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:45.755391 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:45.762033 (+ 6642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:45.762046 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:45.762070 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:45.762127 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:45.765952 (+ 3825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:45.766902 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:45.766916 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:45.766924 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:45.767151 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:45.767850 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:45.767855 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:45.767857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:45.768607 (+ 750us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:45.769022 (+ 415us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:45.769622 (+ 600us) server_negotiation.cc:299] Negotiation successful
0811 07:07:45.770257 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":466,"threads_started":1}
I20260811 07:07:45.773437 20835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1: No bootstrap required, opened a new log
I20260811 07:07:45.783439 20835 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14f71898e5ab4325b5b6c966c0b4bdb1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41157 } }
I20260811 07:07:45.783999 20835 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:45.784134 20835 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f71898e5ab4325b5b6c966c0b4bdb1, State: Initialized, Role: FOLLOWER
I20260811 07:07:45.784958 20835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14f71898e5ab4325b5b6c966c0b4bdb1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41157 } }
I20260811 07:07:45.785292 20835 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:45.785492 20835 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:45.785698 20835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:45.788627 20835 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14f71898e5ab4325b5b6c966c0b4bdb1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41157 } }
I20260811 07:07:45.789273 20835 leader_election.cc:302] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14f71898e5ab4325b5b6c966c0b4bdb1; no voters:
I20260811 07:07:45.790362 20835 leader_election.cc:288] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:07:45.790560 20840 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:45.791481 20840 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [term 1 LEADER]: Becoming Leader. State: Replica: 14f71898e5ab4325b5b6c966c0b4bdb1, State: Running, Role: LEADER
I20260811 07:07:45.792107 20840 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14f71898e5ab4325b5b6c966c0b4bdb1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41157 } }
I20260811 07:07:45.793207 20835 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:45.795557 20842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14f71898e5ab4325b5b6c966c0b4bdb1. Latest consensus state: current_term: 1 leader_uuid: "14f71898e5ab4325b5b6c966c0b4bdb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14f71898e5ab4325b5b6c966c0b4bdb1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41157 } } }
I20260811 07:07:45.796000 20842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:45.796780 20841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14f71898e5ab4325b5b6c966c0b4bdb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14f71898e5ab4325b5b6c966c0b4bdb1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41157 } } }
I20260811 07:07:45.797297 20841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:45.803159 20845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:45.808629 20845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:45.819530 20845 catalog_manager.cc:1347] Generated new cluster ID: e77c468d6f3a4b7894b8a4c46477957b
I20260811 07:07:45.819701 20845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:45.867422 20845 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:07:45.869746 20845 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:45.889688 20845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1: Generated new TSK 0
I20260811 07:07:45.891150 20845 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.73.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
Entry for principal kudu/127.30.73.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab.
I20260811 07:07:46.003031 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:41157
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:46.482164 20862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:46.482559 20862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:46.482671 20862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:46.491219 20862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:46.491469 20862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:46.491673 20862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:07:46.503872 20862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.65.keytab
--principal=kudu/127.30.73.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:41157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:46.505657 20862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:46.507319 20862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:46.523443 20869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:46.523561 20868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:46.523537 20871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:46.527969 20862 server_base.cc:1034] running on GCE node
I20260811 07:07:46.528903 20862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:46.530313 20862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:46.531607 20862 hybrid_clock.cc:648] HybridClock initialized: now 1786432066531565 us; error 40 us; skew 500 ppm
I20260811 07:07:46.532053 20862 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:46 dist-test-slave-69rg krb5kdc[20744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432066, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:46.536252 20862 init.cc:377] Logged in from keytab as kudu/127.30.73.65@KRBTEST.COM (short username kudu)
I20260811 07:07:46.538388 20862 webserver.cc:460] Webserver started at http://127.30.73.65:43923/ using document root <none> and password file <none>
I20260811 07:07:46.539355 20862 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:46.539523 20862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:46.539920 20862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:46.543646 20862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "7a9af13cf30147fbbbee1adacde904dc"
format_stamp: "Formatted at 2026-08-11 07:07:46 on dist-test-slave-69rg"
server_key: "450bd77783d74fdbc9d346e626920087"
server_key_iv: "85a392c7ca8637b712db61e9d54f0bce"
server_key_version: "encryptionkey@0"
I20260811 07:07:46.544549 20862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "7a9af13cf30147fbbbee1adacde904dc"
format_stamp: "Formatted at 2026-08-11 07:07:46 on dist-test-slave-69rg"
server_key: "450bd77783d74fdbc9d346e626920087"
server_key_iv: "85a392c7ca8637b712db61e9d54f0bce"
server_key_version: "encryptionkey@0"
I20260811 07:07:46.551143 20862 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 07:07:46.555554 20880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:46.557247 20862 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:07:46.557482 20862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "7a9af13cf30147fbbbee1adacde904dc"
format_stamp: "Formatted at 2026-08-11 07:07:46 on dist-test-slave-69rg"
server_key: "450bd77783d74fdbc9d346e626920087"
server_key_iv: "85a392c7ca8637b712db61e9d54f0bce"
server_key_version: "encryptionkey@0"
I20260811 07:07:46.557754 20862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:46.576885 20862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:46.582113 20862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:46.582484 20862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:46.583740 20862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:46.585507 20862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:46.585629 20862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:46.585844 20862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:46.585924 20862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 07:07:46.622850 20862 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:38789
I20260811 07:07:46.622869 21012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:38789 every 8 connection(s)
I20260811 07:07:46.624652 20862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:07:46.625919 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 20862
I20260811 07:07:46.626158 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:07:46.626711 31013 external_mini_cluster.cc:1428] Setting key 6f21fd5da9fd65f1e3f96ccc0cb82aad
Aug 11 07:07:46 dist-test-slave-69rg krb5kdc[20744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432066, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.65@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:46.652842 21015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:46.628132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:38571 (local address 127.30.73.126:41157)
0811 07:07:46.634316 (+ 6184us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:46.634325 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:46.634349 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:07:46.634427 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:46.634435 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:46.634541 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:46.634678 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:46.636649 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:46.637940 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:46.639775 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:46.640550 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:46.640707 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:46.645136 (+ 4429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:46.645142 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:46.645146 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:46.645188 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:46.648727 (+ 3539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:46.649545 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:46.649555 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:46.649563 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:46.649753 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:46.650339 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:46.650348 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:46.650356 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:46.650876 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:46.651058 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:46.651927 (+ 869us) server_negotiation.cc:299] Negotiation successful
0811 07:07:46.652264 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5995,"thread_start_us":5835,"threads_started":1}
I20260811 07:07:46.653649 21016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:46.628987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:41157 (local address 127.30.73.65:38571)
0811 07:07:46.630155 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:46.630217 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:46.633249 (+ 3032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:46.635021 (+ 1772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:46.635032 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:46.635700 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:46.636420 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:46.636442 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:46.638134 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:46.638139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:46.639582 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:46.639596 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:46.640791 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:46.640797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:46.641036 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:46.641953 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:46.641986 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:46.644859 (+ 2873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:46.648880 (+ 4021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:46.648888 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:46.648905 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:46.649410 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:46.649946 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:46.649949 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:46.649952 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:46.650207 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:46.651039 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:46.651046 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:46.651462 (+ 416us) client_negotiation.cc:769] Sending connection context
0811 07:07:46.651755 (+ 293us) client_negotiation.cc:240] Negotiation successful
0811 07:07:46.652263 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":429,"threads_started":1}
I20260811 07:07:46.655634 21013 heartbeater.cc:347] Connected to a master server at 127.30.73.126:41157
I20260811 07:07:46.656010 21013 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:46.656919 21013 heartbeater.cc:511] Master 127.30.73.126:41157 requested a full tablet report, sending...
I20260811 07:07:46.659621 20794 ts_manager.cc:194] Registered new tserver with Master: 7a9af13cf30147fbbbee1adacde904dc (127.30.73.65:38789)
I20260811 07:07:46.661429 20794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.65@KRBTEST.COM'} at 127.30.73.65:38571
WARNING: no policy specified for kudu/127.30.73.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
Entry for principal kudu/127.30.73.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab.
I20260811 07:07:46.718392 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:41157
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:47.149806 21020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:47.150220 21020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:47.150399 21020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:47.159096 21020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:47.159260 21020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:47.159505 21020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:07:47.171353 21020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.66.keytab
--principal=kudu/127.30.73.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:41157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:47.173192 21020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:47.175016 21020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:47.192148 21026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:47.192174 21030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:47.192227 21027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:47.199177 21020 server_base.cc:1034] running on GCE node
I20260811 07:07:47.200388 21020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:47.202109 21020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:47.203387 21020 hybrid_clock.cc:648] HybridClock initialized: now 1786432067203324 us; error 62 us; skew 500 ppm
I20260811 07:07:47.203820 21020 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:47 dist-test-slave-69rg krb5kdc[20744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432067, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:47.213193 21020 init.cc:377] Logged in from keytab as kudu/127.30.73.66@KRBTEST.COM (short username kudu)
I20260811 07:07:47.215461 21020 webserver.cc:460] Webserver started at http://127.30.73.66:39361/ using document root <none> and password file <none>
I20260811 07:07:47.216493 21020 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:47.216625 21020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:47.217097 21020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:47.220973 21020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "6c65bd71d668499bbfb1d3671d742f6b"
format_stamp: "Formatted at 2026-08-11 07:07:47 on dist-test-slave-69rg"
server_key: "df5e1828e25a028feaafc27f513058c1"
server_key_iv: "893278f5b2d000b58afd3971ebf7cf42"
server_key_version: "encryptionkey@0"
I20260811 07:07:47.222034 21020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "6c65bd71d668499bbfb1d3671d742f6b"
format_stamp: "Formatted at 2026-08-11 07:07:47 on dist-test-slave-69rg"
server_key: "df5e1828e25a028feaafc27f513058c1"
server_key_iv: "893278f5b2d000b58afd3971ebf7cf42"
server_key_version: "encryptionkey@0"
I20260811 07:07:47.229272 21020 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260811 07:07:47.234294 21038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:47.236135 21020 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260811 07:07:47.236408 21020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "6c65bd71d668499bbfb1d3671d742f6b"
format_stamp: "Formatted at 2026-08-11 07:07:47 on dist-test-slave-69rg"
server_key: "df5e1828e25a028feaafc27f513058c1"
server_key_iv: "893278f5b2d000b58afd3971ebf7cf42"
server_key_version: "encryptionkey@0"
I20260811 07:07:47.236721 21020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:47.262233 21020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:47.267604 21020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:47.267983 21020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:47.269315 21020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:47.271034 21020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:47.271157 21020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:47.271329 21020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:47.271420 21020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:47.314065 21020 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:39609
I20260811 07:07:47.314121 21173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:39609 every 8 connection(s)
I20260811 07:07:47.315758 21020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:07:47.319808 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 21020
I20260811 07:07:47.320055 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:07:47.320852 31013 external_mini_cluster.cc:1428] Setting key f5743202c87028a5c085e8557b1a72eb
Aug 11 07:07:47 dist-test-slave-69rg krb5kdc[20744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432067, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.66@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:47.342519 21176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:47.319429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:48683 (local address 127.30.73.126:41157)
0811 07:07:47.320132 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:47.320143 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:47.321472 (+ 1329us) server_negotiation.cc:407] Connection header received
0811 07:07:47.324245 (+ 2773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:47.324253 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:47.324380 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:47.324537 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:47.326700 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.327560 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.329540 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.330159 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.330324 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:47.335242 (+ 4918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:47.335249 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:47.335253 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:47.335300 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:47.338591 (+ 3291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:47.339522 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:47.339527 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:47.339529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:47.339672 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:47.340197 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:47.340201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:47.340204 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:47.340555 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:47.340737 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:47.341707 (+ 970us) server_negotiation.cc:299] Negotiation successful
0811 07:07:47.342118 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":364,"threads_started":1}
I20260811 07:07:47.344141 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:47.320157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:41157 (local address 127.30.73.66:48683)
0811 07:07:47.321252 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:47.321310 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:47.323876 (+ 2566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:47.324860 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:47.324873 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:47.325582 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:47.326466 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:47.326492 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.327760 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.327764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:47.329357 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:47.329372 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.330449 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.330458 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:47.330765 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:47.331696 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:47.331726 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:47.334852 (+ 3126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:47.338774 (+ 3922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:47.338787 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:47.338810 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:47.339378 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:47.339796 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:47.339801 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:47.339805 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:47.340056 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:47.340708 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:47.340741 (+ 33us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:47.341197 (+ 456us) client_negotiation.cc:769] Sending connection context
0811 07:07:47.341559 (+ 362us) client_negotiation.cc:240] Negotiation successful
0811 07:07:47.342322 (+ 763us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":418,"threads_started":1}
I20260811 07:07:47.346165 21174 heartbeater.cc:347] Connected to a master server at 127.30.73.126:41157
I20260811 07:07:47.346585 21174 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:47.347777 21174 heartbeater.cc:511] Master 127.30.73.126:41157 requested a full tablet report, sending...
I20260811 07:07:47.350001 20794 ts_manager.cc:194] Registered new tserver with Master: 6c65bd71d668499bbfb1d3671d742f6b (127.30.73.66:39609)
I20260811 07:07:47.351055 20794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.66@KRBTEST.COM'} at 127.30.73.66:48683
WARNING: no policy specified for kudu/127.30.73.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
Entry for principal kudu/127.30.73.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab.
I20260811 07:07:47.407073 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:41157
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:33839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:07:47.665105 21013 heartbeater.cc:503] Master 127.30.73.126:41157 was elected leader, sending a full tablet report...
W20260811 07:07:47.790571 21180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:47.790915 21180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:47.791083 21180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:47.798847 21180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:47.799002 21180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:47.799180 21180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:07:47.809540 21180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:33839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.67.keytab
--principal=kudu/127.30.73.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:41157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:47.810983 21180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:47.812367 21180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:47.826339 21189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:47.826287 21192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:47.826364 21190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:47.827656 21180 server_base.cc:1034] running on GCE node
I20260811 07:07:47.828284 21180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:47.829352 21180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:47.830562 21180 hybrid_clock.cc:648] HybridClock initialized: now 1786432067830494 us; error 58 us; skew 500 ppm
I20260811 07:07:47.830909 21180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:47 dist-test-slave-69rg krb5kdc[20744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432067, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:47.834394 21180 init.cc:377] Logged in from keytab as kudu/127.30.73.67@KRBTEST.COM (short username kudu)
I20260811 07:07:47.836059 21180 webserver.cc:460] Webserver started at http://127.30.73.67:37089/ using document root <none> and password file <none>
I20260811 07:07:47.836766 21180 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:47.836874 21180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:47.837153 21180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:47.840377 21180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "6010bf300ce840609e3aed3c3a94894e"
format_stamp: "Formatted at 2026-08-11 07:07:47 on dist-test-slave-69rg"
server_key: "cda20b082cb9f0794076e5f076afb09b"
server_key_iv: "ecf06cb4b09d69fb42cc8604f164b3f3"
server_key_version: "encryptionkey@0"
I20260811 07:07:47.841406 21180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "6010bf300ce840609e3aed3c3a94894e"
format_stamp: "Formatted at 2026-08-11 07:07:47 on dist-test-slave-69rg"
server_key: "cda20b082cb9f0794076e5f076afb09b"
server_key_iv: "ecf06cb4b09d69fb42cc8604f164b3f3"
server_key_version: "encryptionkey@0"
I20260811 07:07:47.847965 21180 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:07:47.852809 21201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:47.854625 21180 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:07:47.854843 21180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "6010bf300ce840609e3aed3c3a94894e"
format_stamp: "Formatted at 2026-08-11 07:07:47 on dist-test-slave-69rg"
server_key: "cda20b082cb9f0794076e5f076afb09b"
server_key_iv: "ecf06cb4b09d69fb42cc8604f164b3f3"
server_key_version: "encryptionkey@0"
I20260811 07:07:47.855094 21180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:47.876026 21180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:47.882333 21180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:47.882715 21180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:47.883901 21180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:47.885603 21180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:47.885694 21180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:47.885932 21180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:47.886058 21180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:47.920833 21180 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:42517
I20260811 07:07:47.920841 21337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:42517 every 8 connection(s)
I20260811 07:07:47.922231 21180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:07:47.931275 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 21180
I20260811 07:07:47.931468 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:07:47.931959 31013 external_mini_cluster.cc:1428] Setting key e78821220693da536a5ccfda5c859ab1
Aug 11 07:07:47 dist-test-slave-69rg krb5kdc[20744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432067, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.67@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:07:47.943787 21340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:47.925146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:35127 (local address 127.30.73.126:41157)
0811 07:07:47.925670 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:47.925691 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:47.926594 (+ 903us) server_negotiation.cc:407] Connection header received
0811 07:07:47.928427 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:47.928432 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:47.928520 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:47.928620 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:47.930151 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.931055 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.932903 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.933622 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.933775 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:47.937554 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:47.937560 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:47.937563 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:47.937598 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:47.940492 (+ 2894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:47.941372 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:47.941376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:47.941378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:47.941504 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:47.942033 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:47.942037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:47.942039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:47.942351 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:47.942479 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:47.943281 (+ 802us) server_negotiation.cc:299] Negotiation successful
0811 07:07:47.943477 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":269,"threads_started":1}
I20260811 07:07:47.944823 21341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:47.925645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:41157 (local address 127.30.73.67:35127)
0811 07:07:47.926429 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:47.926469 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:47.928150 (+ 1681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:47.928842 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:47.928849 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:47.929371 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:47.929997 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:47.930015 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.931218 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.931222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:47.932768 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:47.932781 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.933946 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.933955 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:47.934221 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:47.934974 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:07:47.935015 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:47.937298 (+ 2283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:47.940715 (+ 3417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:47.940726 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:47.940745 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:47.941241 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:47.941625 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:07:47.941629 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:07:47.941631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:07:47.941914 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:07:47.942485 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:47.942492 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:47.942843 (+ 351us) client_negotiation.cc:769] Sending connection context
0811 07:07:47.943138 (+ 295us) client_negotiation.cc:240] Negotiation successful
0811 07:07:47.943555 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":341,"threads_started":1}
I20260811 07:07:47.946552 21338 heartbeater.cc:347] Connected to a master server at 127.30.73.126:41157
I20260811 07:07:47.946905 21338 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:47.947830 21338 heartbeater.cc:511] Master 127.30.73.126:41157 requested a full tablet report, sending...
I20260811 07:07:47.949355 20794 ts_manager.cc:194] Registered new tserver with Master: 6010bf300ce840609e3aed3c3a94894e (127.30.73.67:42517)
I20260811 07:07:47.950286 20794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.73.67@KRBTEST.COM'} at 127.30.73.67:35127
I20260811 07:07:47.960407 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:07:47.979475 21340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:47.965479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57220 (local address 127.30.73.126:41157)
0811 07:07:47.965749 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:47.965759 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:47.966238 (+ 479us) server_negotiation.cc:407] Connection header received
0811 07:07:47.966470 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:47.966475 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:47.966578 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:47.966702 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:47.968375 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.969190 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.970747 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:47.971176 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:47.971332 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:47.973989 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:47.973995 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:47.973998 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:47.974033 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:47.976598 (+ 2565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:47.977331 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:47.977337 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:47.977345 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:47.977470 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:47.977912 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:47.977916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:47.977918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:47.978267 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:47.978531 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:47.978909 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 07:07:47.979143 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:07:47.983778 20794 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:07:47.992126 20794 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:07:48.029460 21354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.006321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34014 (local address 127.30.73.66:39609)
0811 07:07:48.019746 (+ 13425us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:48.019759 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:48.021025 (+ 1266us) server_negotiation.cc:407] Connection header received
0811 07:07:48.021178 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:48.021186 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:48.021410 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:48.021634 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:48.022744 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.024271 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.026869 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.028182 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.028338 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.028559 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:48.028932 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 07:07:48.029110 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13219,"thread_start_us":13080,"threads_started":1}
I20260811 07:07:48.029527 21357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.006095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39609 (local address 127.0.0.1:34014)
0811 07:07:48.020598 (+ 14503us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:48.020636 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:48.020850 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:48.021946 (+ 1096us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:48.021951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:48.021986 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:48.022531 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.022545 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.024418 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.024423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.026700 (+ 2277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.026714 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.028438 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.028444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.028658 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.028720 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 07:07:48.028864 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 07:07:48.029068 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10898,"mutex_wait_us":1,"thread_start_us":13740,"threads_started":1}
I20260811 07:07:48.030951 21356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.006859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37400 (local address 127.30.73.65:38789)
0811 07:07:48.020340 (+ 13481us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:48.020350 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:48.020386 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:07:48.020789 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:48.020801 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:48.021117 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:48.021329 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:48.022132 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.023847 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.027484 (+ 3637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.028985 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.029124 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.029367 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:48.030427 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0811 07:07:48.030607 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13289,"thread_start_us":13529,"threads_started":1}
I20260811 07:07:48.031913 21358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.007754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51324 (local address 127.30.73.67:42517)
0811 07:07:48.018258 (+ 10504us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:48.018270 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:48.023280 (+ 5010us) server_negotiation.cc:407] Connection header received
0811 07:07:48.023428 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:48.023435 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:48.023630 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:48.023837 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:48.024680 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.026562 (+ 1882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.028695 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.030796 (+ 2101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.030939 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.031172 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:48.031388 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 07:07:48.031556 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10181,"thread_start_us":10479,"threads_started":1}
I20260811 07:07:48.034198 21351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.006608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:38789 (local address 127.0.0.1:37400)
0811 07:07:48.020183 (+ 13575us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:48.020246 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:48.020464 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:48.021337 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:48.021344 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:48.021390 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:48.021847 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.021870 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.024068 (+ 2198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.024074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.027289 (+ 3215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.027304 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.029541 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.029549 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.029775 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.029807 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 07:07:48.029912 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:07:48.030046 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13434,"mutex_wait_us":1,"thread_start_us":16232,"threads_started":1}
I20260811 07:07:48.034478 21355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.006906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:42517 (local address 127.0.0.1:51324)
0811 07:07:48.023139 (+ 16233us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:48.023158 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:48.023285 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:48.023851 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:48.023856 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:48.023888 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:48.024387 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.024400 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.026771 (+ 2371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.026776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.028460 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.028473 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.031004 (+ 2531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.031010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.031180 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.031212 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 07:07:48.031329 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 07:07:48.031471 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16079,"thread_start_us":9852,"threads_started":1}
I20260811 07:07:48.034147 21094 tablet_service.cc:1467] Processing CreateTablet for tablet 5c711bf9bc48428bb08c66a50f89818c (DEFAULT_TABLE table=test-table [id=1e144f0d764a4a178d32eba98a08b8f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:48.035869 21094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c711bf9bc48428bb08c66a50f89818c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:48.038511 21261 tablet_service.cc:1467] Processing CreateTablet for tablet 5c711bf9bc48428bb08c66a50f89818c (DEFAULT_TABLE table=test-table [id=1e144f0d764a4a178d32eba98a08b8f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:48.040102 21261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c711bf9bc48428bb08c66a50f89818c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:48.045301 20935 tablet_service.cc:1467] Processing CreateTablet for tablet 5c711bf9bc48428bb08c66a50f89818c (DEFAULT_TABLE table=test-table [id=1e144f0d764a4a178d32eba98a08b8f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:48.046671 20935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c711bf9bc48428bb08c66a50f89818c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:48.051882 21359 tablet_bootstrap.cc:492] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: Bootstrap starting.
I20260811 07:07:48.054980 21360 tablet_bootstrap.cc:492] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: Bootstrap starting.
I20260811 07:07:48.056195 21359 tablet_bootstrap.cc:654] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:48.057729 21359 log.cc:824] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:48.058398 21360 tablet_bootstrap.cc:654] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:48.059706 21360 log.cc:824] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:48.065709 21363 tablet_bootstrap.cc:492] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: Bootstrap starting.
I20260811 07:07:48.071067 21359 tablet_bootstrap.cc:492] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: No bootstrap required, opened a new log
I20260811 07:07:48.071468 21359 ts_tablet_manager.cc:1397] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.006s
I20260811 07:07:48.071749 21360 tablet_bootstrap.cc:492] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: No bootstrap required, opened a new log
I20260811 07:07:48.072083 21360 ts_tablet_manager.cc:1397] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.005s
I20260811 07:07:48.074182 21363 tablet_bootstrap.cc:654] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:48.075557 21363 log.cc:824] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:48.079852 21363 tablet_bootstrap.cc:492] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: No bootstrap required, opened a new log
I20260811 07:07:48.080164 21363 ts_tablet_manager.cc:1397] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.005s
I20260811 07:07:48.084204 21360 raft_consensus.cc:348] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } }
I20260811 07:07:48.084249 21359 raft_consensus.cc:348] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } }
I20260811 07:07:48.084713 21359 raft_consensus.cc:374] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:48.084764 21360 raft_consensus.cc:374] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:48.084856 21359 raft_consensus.cc:729] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c65bd71d668499bbfb1d3671d742f6b, State: Initialized, Role: FOLLOWER
I20260811 07:07:48.084888 21360 raft_consensus.cc:729] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6010bf300ce840609e3aed3c3a94894e, State: Initialized, Role: FOLLOWER
I20260811 07:07:48.085695 21360 consensus_queue.cc:260] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } }
I20260811 07:07:48.085690 21359 consensus_queue.cc:260] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } }
I20260811 07:07:48.087141 21174 heartbeater.cc:503] Master 127.30.73.126:41157 was elected leader, sending a full tablet report...
I20260811 07:07:48.087514 21338 heartbeater.cc:503] Master 127.30.73.126:41157 was elected leader, sending a full tablet report...
I20260811 07:07:48.088024 21359 ts_tablet_manager.cc:1428] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: Time spent starting tablet: real 0.016s user 0.011s sys 0.006s
I20260811 07:07:48.088107 21360 ts_tablet_manager.cc:1428] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260811 07:07:48.091101 21363 raft_consensus.cc:348] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } }
I20260811 07:07:48.091606 21363 raft_consensus.cc:374] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:48.092352 21363 raft_consensus.cc:729] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a9af13cf30147fbbbee1adacde904dc, State: Initialized, Role: FOLLOWER
I20260811 07:07:48.093041 21363 consensus_queue.cc:260] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } }
I20260811 07:07:48.095170 21363 ts_tablet_manager.cc:1428] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: Time spent starting tablet: real 0.015s user 0.011s sys 0.003s
W20260811 07:07:48.127818 21014 tablet.cc:2369] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:07:48.139618 21367 raft_consensus.cc:482] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:48.139955 21367 raft_consensus.cc:504] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } }
I20260811 07:07:48.142122 21367 leader_election.cc:288] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c65bd71d668499bbfb1d3671d742f6b (127.30.73.66:39609), 6010bf300ce840609e3aed3c3a94894e (127.30.73.67:42517)
I20260811 07:07:48.149394 21354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.142752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:59103 (local address 127.30.73.66:39609)
0811 07:07:48.143036 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:48.143045 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:48.143604 (+ 559us) server_negotiation.cc:407] Connection header received
0811 07:07:48.143849 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:48.143853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:48.143917 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:48.144016 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:48.144672 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.145579 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.147580 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.148380 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.148575 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.148673 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:48.148978 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 07:07:48.149110 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 07:07:48.149433 21358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.142609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:50243 (local address 127.30.73.67:42517)
0811 07:07:48.142830 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:48.142838 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:48.143730 (+ 892us) server_negotiation.cc:407] Connection header received
0811 07:07:48.143942 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:48.143947 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:48.144004 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:48.144104 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:48.144960 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.145978 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.147684 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.148459 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.148654 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.148732 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:48.149030 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 07:07:48.149162 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:07:48.149578 21369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.142329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39609 (local address 127.30.73.65:59103)
0811 07:07:48.143484 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:48.143503 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:48.143685 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:48.144040 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:48.144045 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:48.144070 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:48.144512 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.144525 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.145885 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.145890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.147412 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.147425 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.148631 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.148638 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.148810 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.148839 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:07:48.148950 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:07:48.149087 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"mutex_wait_us":62,"thread_start_us":948,"threads_started":1}
I20260811 07:07:48.149627 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.142608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:42517 (local address 127.30.73.65:50243)
0811 07:07:48.143617 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:48.143631 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:48.143788 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:48.144120 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:48.144129 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:48.144167 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:48.144762 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.144777 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.146113 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.146118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.147519 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:48.147531 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.148690 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.148696 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:48.148872 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.148894 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 07:07:48.148999 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:07:48.149123 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":905,"spinlock_wait_cycles":5376,"thread_start_us":486,"threads_started":1}
I20260811 07:07:48.150810 21122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c711bf9bc48428bb08c66a50f89818c" candidate_uuid: "7a9af13cf30147fbbbee1adacde904dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c65bd71d668499bbfb1d3671d742f6b" is_pre_election: true
I20260811 07:07:48.150866 21286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c711bf9bc48428bb08c66a50f89818c" candidate_uuid: "7a9af13cf30147fbbbee1adacde904dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6010bf300ce840609e3aed3c3a94894e" is_pre_election: true
I20260811 07:07:48.151361 21122 raft_consensus.cc:2454] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a9af13cf30147fbbbee1adacde904dc in term 0.
I20260811 07:07:48.151361 21286 raft_consensus.cc:2454] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a9af13cf30147fbbbee1adacde904dc in term 0.
I20260811 07:07:48.152091 20885 leader_election.cc:302] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6010bf300ce840609e3aed3c3a94894e, 6c65bd71d668499bbfb1d3671d742f6b, 7a9af13cf30147fbbbee1adacde904dc; no voters:
I20260811 07:07:48.152787 21367 raft_consensus.cc:2781] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:07:48.152963 21367 raft_consensus.cc:482] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:07:48.153088 21367 raft_consensus.cc:3037] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:48.155726 21367 raft_consensus.cc:504] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } }
I20260811 07:07:48.156425 21367 leader_election.cc:288] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [CANDIDATE]: Term 1 election: Requested vote from peers 6c65bd71d668499bbfb1d3671d742f6b (127.30.73.66:39609), 6010bf300ce840609e3aed3c3a94894e (127.30.73.67:42517)
I20260811 07:07:48.156967 21122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c711bf9bc48428bb08c66a50f89818c" candidate_uuid: "7a9af13cf30147fbbbee1adacde904dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c65bd71d668499bbfb1d3671d742f6b"
I20260811 07:07:48.157017 21286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c711bf9bc48428bb08c66a50f89818c" candidate_uuid: "7a9af13cf30147fbbbee1adacde904dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6010bf300ce840609e3aed3c3a94894e"
I20260811 07:07:48.157208 21122 raft_consensus.cc:3037] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:48.157254 21286 raft_consensus.cc:3037] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:48.159979 21122 raft_consensus.cc:2454] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a9af13cf30147fbbbee1adacde904dc in term 1.
I20260811 07:07:48.159997 21286 raft_consensus.cc:2454] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a9af13cf30147fbbbee1adacde904dc in term 1.
I20260811 07:07:48.160501 20885 leader_election.cc:302] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6010bf300ce840609e3aed3c3a94894e, 7a9af13cf30147fbbbee1adacde904dc; no voters:
I20260811 07:07:48.160938 21367 raft_consensus.cc:2781] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:48.161504 21367 raft_consensus.cc:686] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 1 LEADER]: Becoming Leader. State: Replica: 7a9af13cf30147fbbbee1adacde904dc, State: Running, Role: LEADER
I20260811 07:07:48.162175 21367 consensus_queue.cc:237] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } }
I20260811 07:07:48.167717 20794 catalog_manager.cc:5495] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a9af13cf30147fbbbee1adacde904dc (127.30.73.65). New cstate: current_term: 1 leader_uuid: "7a9af13cf30147fbbbee1adacde904dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a9af13cf30147fbbbee1adacde904dc" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 38789 } health_report { overall_health: HEALTHY } } }
W20260811 07:07:48.174167 21339 tablet.cc:2369] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:07:48.188637 21356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.182766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37414 (local address 127.30.73.65:38789)
0811 07:07:48.183018 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:48.183027 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:48.183126 (+ 99us) server_negotiation.cc:407] Connection header received
0811 07:07:48.183408 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:48.183412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:48.183513 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:48.183673 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:07:48.184075 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.184912 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.186442 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.186881 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.187020 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.187511 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:07:48.188037 (+ 526us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:07:48.188210 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:48.188275 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 07:07:48.188359 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:07:48.198173 21286 raft_consensus.cc:1261] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [term 1 FOLLOWER]: Refusing update from remote peer 7a9af13cf30147fbbbee1adacde904dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:48.198172 21122 raft_consensus.cc:1261] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [term 1 FOLLOWER]: Refusing update from remote peer 7a9af13cf30147fbbbee1adacde904dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:48.199299 21370 consensus_queue.cc:1035] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6010bf300ce840609e3aed3c3a94894e" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 42517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:48.199695 21367 consensus_queue.cc:1035] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c65bd71d668499bbfb1d3671d742f6b" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:48.214107 21377 mvcc.cc:205] Tried to move back new op lower bound from 7317225751326883840 to 7317225751197130752. Current Snapshot: MvccSnapshot[applied={T|T < 7317225751326883840}]
I20260811 07:07:48.229243 20793 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:48.229645 20793 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:48.234200 20793 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14f71898e5ab4325b5b6c966c0b4bdb1: Sending DeleteTablet for 3 replicas of tablet 5c711bf9bc48428bb08c66a50f89818c
I20260811 07:07:48.235683 20935 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c711bf9bc48428bb08c66a50f89818c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:48 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:37400
I20260811 07:07:48.235692 21261 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c711bf9bc48428bb08c66a50f89818c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:48 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:51324
I20260811 07:07:48.235667 21094 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c711bf9bc48428bb08c66a50f89818c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:48 UTC) from {username='kudu', principal='kudu/127.30.73.126@KRBTEST.COM'} at 127.0.0.1:34014
I20260811 07:07:48.245188 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 20862
I20260811 07:07:48.247740 21388 tablet_replica.cc:330] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: stopping tablet replica
I20260811 07:07:48.248436 21388 raft_consensus.cc:2229] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:07:48.249352 21388 raft_consensus.cc:2258] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:48.251127 21385 tablet_replica.cc:330] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: stopping tablet replica
I20260811 07:07:48.251920 21387 tablet_replica.cc:330] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: stopping tablet replica
I20260811 07:07:48.251924 21388 ts_tablet_manager.cc:1905] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:48.252681 21387 raft_consensus.cc:2229] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:48.253376 21385 raft_consensus.cc:2229] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:48.254361 21385 raft_consensus.cc:2258] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:48.254851 21387 raft_consensus.cc:2258] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:48.258319 21385 ts_tablet_manager.cc:1905] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:48.261283 21388 ts_tablet_manager.cc:1918] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:48.261477 21388 log.cc:1196] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/5c711bf9bc48428bb08c66a50f89818c
I20260811 07:07:48.262357 21388 ts_tablet_manager.cc:1939] T 5c711bf9bc48428bb08c66a50f89818c P 7a9af13cf30147fbbbee1adacde904dc: Deleting consensus metadata
I20260811 07:07:48.264621 20778 catalog_manager.cc:4841] TS 7a9af13cf30147fbbbee1adacde904dc (127.30.73.65:38789): tablet 5c711bf9bc48428bb08c66a50f89818c (table test-table [id=1e144f0d764a4a178d32eba98a08b8f5]) successfully deleted
I20260811 07:07:48.265949 21387 ts_tablet_manager.cc:1905] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:48.266345 21385 ts_tablet_manager.cc:1918] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:48.266597 21385 log.cc:1196] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/5c711bf9bc48428bb08c66a50f89818c
I20260811 07:07:48.267299 21385 ts_tablet_manager.cc:1939] T 5c711bf9bc48428bb08c66a50f89818c P 6c65bd71d668499bbfb1d3671d742f6b: Deleting consensus metadata
I20260811 07:07:48.269270 20777 catalog_manager.cc:4841] TS 6c65bd71d668499bbfb1d3671d742f6b (127.30.73.66:39609): tablet 5c711bf9bc48428bb08c66a50f89818c (table test-table [id=1e144f0d764a4a178d32eba98a08b8f5]) successfully deleted
Aug 11 07:07:48 dist-test-slave-69rg krb5kdc[20744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.65@KRBTEST.COM
I20260811 07:07:48.273844 21387 ts_tablet_manager.cc:1918] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:48.274036 21387 log.cc:1196] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/5c711bf9bc48428bb08c66a50f89818c
I20260811 07:07:48.274639 21387 ts_tablet_manager.cc:1939] T 5c711bf9bc48428bb08c66a50f89818c P 6010bf300ce840609e3aed3c3a94894e: Deleting consensus metadata
I20260811 07:07:48.276587 20780 catalog_manager.cc:4841] TS 6010bf300ce840609e3aed3c3a94894e (127.30.73.67:42517): tablet 5c711bf9bc48428bb08c66a50f89818c (table test-table [id=1e144f0d764a4a178d32eba98a08b8f5]) successfully deleted
I20260811 07:07:48.281554 21356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.247112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37416 (local address 127.30.73.65:38789)
0811 07:07:48.247387 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:48.247402 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:48.259710 (+ 12308us) server_negotiation.cc:407] Connection header received
0811 07:07:48.261911 (+ 2201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:48.261918 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:48.262058 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:48.262164 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:48.265304 (+ 3140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.266693 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.268890 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.269623 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.269767 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.274666 (+ 4899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:48.274680 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:48.274695 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:48.274768 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:48.278403 (+ 3635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:48.279182 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:48.279191 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:48.279193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:48.279352 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:48.279800 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:48.279806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:48.279812 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:48.280206 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:48.280551 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:48.280904 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 07:07:48.281186 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 07:07:48.282398 21008 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:48.387121 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 20862
I20260811 07:07:48.410355 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 21020
Aug 11 07:07:48 dist-test-slave-69rg krb5kdc[20744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.66@KRBTEST.COM
I20260811 07:07:48.426993 21354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.411252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34026 (local address 127.30.73.66:39609)
0811 07:07:48.411461 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:48.411466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:48.411487 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:07:48.411546 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:48.411551 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:48.411631 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:48.411724 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:48.413049 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.413998 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.415252 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.415715 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.415822 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.420598 (+ 4776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:48.420613 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:48.420631 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:48.420665 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:48.423923 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:48.424691 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:48.424699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:48.424702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:48.424842 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:48.425261 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:48.425266 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:48.425271 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:48.425696 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:48.426050 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:48.426380 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 07:07:48.426622 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:07:48.427824 21169 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:48.519858 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 21020
I20260811 07:07:48.542052 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 21180
Aug 11 07:07:48 dist-test-slave-69rg krb5kdc[20744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.67@KRBTEST.COM
I20260811 07:07:48.562961 21358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:48.542874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51326 (local address 127.30.73.67:42517)
0811 07:07:48.543047 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:48.543052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:48.543070 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:07:48.543209 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:48.543213 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:48.543284 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:48.543380 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:48.544768 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.545505 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.546858 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:48.547241 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:48.547339 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:48.557255 (+ 9916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:48.557275 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:48.557293 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:48.557337 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:48.560330 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:48.560996 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:48.561003 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:48.561005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:48.561141 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:48.561555 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:48.561559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:48.561561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:48.561998 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:48.562233 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:48.562515 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 07:07:48.562697 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:07:48.563656 21333 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:48.655736 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 21180
I20260811 07:07:48.678859 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 20759
I20260811 07:07:48.680100 20829 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:48.807982 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 20759
2026-08-11T07:07:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5242 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T07:07:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:48Z Disabled control of system clock
I20260811 07:07:48.907336 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:46215
--webserver_interface=127.30.73.126
--webserver_port=0
--builtin_ntp_servers=127.30.73.84:44523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:46215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:07:49.270738 21398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:49.271045 21398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:49.271129 21398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:49.278406 21398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:49.278513 21398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:49.278551 21398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:49.278610 21398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:49.278662 21398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:49.287892 21398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:46215
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:46215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:49.289237 21398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:49.290967 21398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:49.303915 21405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:49.303851 21408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:49.303946 21406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:49.305030 21398 server_base.cc:1034] running on GCE node
I20260811 07:07:49.306007 21398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:49.307698 21398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:49.309029 21398 hybrid_clock.cc:648] HybridClock initialized: now 1786432069308971 us; error 45 us; skew 500 ppm
I20260811 07:07:49.309430 21398 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:49.311962 21398 webserver.cc:460] Webserver started at http://127.30.73.126:45053/ using document root <none> and password file <none>
I20260811 07:07:49.312690 21398 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:49.312786 21398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:49.313066 21398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:49.316185 21398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "725edd273bd047188465d5911c5314f6"
format_stamp: "Formatted at 2026-08-11 07:07:49 on dist-test-slave-69rg"
server_key: "dad828894e3153aa59356ba6ade86645"
server_key_iv: "3ef6f9c8d1c25c05cf61c28d88c77d0d"
server_key_version: "encryptionkey@0"
I20260811 07:07:49.317016 21398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "725edd273bd047188465d5911c5314f6"
format_stamp: "Formatted at 2026-08-11 07:07:49 on dist-test-slave-69rg"
server_key: "dad828894e3153aa59356ba6ade86645"
server_key_iv: "3ef6f9c8d1c25c05cf61c28d88c77d0d"
server_key_version: "encryptionkey@0"
I20260811 07:07:49.322554 21398 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:07:49.326234 21415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:49.327703 21398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:07:49.327873 21398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "725edd273bd047188465d5911c5314f6"
format_stamp: "Formatted at 2026-08-11 07:07:49 on dist-test-slave-69rg"
server_key: "dad828894e3153aa59356ba6ade86645"
server_key_iv: "3ef6f9c8d1c25c05cf61c28d88c77d0d"
server_key_version: "encryptionkey@0"
I20260811 07:07:49.328061 21398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:49.364086 21398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:49.364959 21398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:49.365235 21398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:49.384800 21398 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:46215
I20260811 07:07:49.384824 21473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:46215 every 8 connection(s)
I20260811 07:07:49.386276 21398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:49.390105 21474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:49.391360 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 21398
I20260811 07:07:49.391561 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:07:49.392180 31013 external_mini_cluster.cc:1428] Setting key f0f202a3641b7980731f418c87c24c6f
I20260811 07:07:49.405290 21474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6: Bootstrap starting.
I20260811 07:07:49.406896 21478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:49.394402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56546 (local address 127.30.73.126:46215)
0811 07:07:49.395737 (+ 1335us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:49.395749 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:49.395793 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:07:49.397573 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:49.397595 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:49.398182 (+ 587us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:49.398506 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:49.399172 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:49.400432 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:49.402375 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:49.403086 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:49.403260 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:49.404553 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:49.404561 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:49.404574 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:49.405114 (+ 540us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:49.405189 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:49.405211 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:49.405337 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:49.405625 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 07:07:49.405984 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":791,"thread_start_us":451,"threads_started":1}
I20260811 07:07:49.408890 21474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:49.410152 21474 log.cc:824] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:49.412789 21474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6: No bootstrap required, opened a new log
I20260811 07:07:49.420392 21474 raft_consensus.cc:348] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725edd273bd047188465d5911c5314f6" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46215 } }
I20260811 07:07:49.420756 21474 raft_consensus.cc:374] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:49.420831 21474 raft_consensus.cc:729] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725edd273bd047188465d5911c5314f6, State: Initialized, Role: FOLLOWER
I20260811 07:07:49.421330 21474 consensus_queue.cc:260] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725edd273bd047188465d5911c5314f6" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46215 } }
I20260811 07:07:49.421543 21474 raft_consensus.cc:388] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:49.421638 21474 raft_consensus.cc:482] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:49.421765 21474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:49.424286 21474 raft_consensus.cc:504] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725edd273bd047188465d5911c5314f6" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46215 } }
I20260811 07:07:49.424778 21474 leader_election.cc:302] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 725edd273bd047188465d5911c5314f6; no voters:
I20260811 07:07:49.425328 21474 leader_election.cc:288] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:07:49.425500 21481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:49.426415 21481 raft_consensus.cc:686] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [term 1 LEADER]: Becoming Leader. State: Replica: 725edd273bd047188465d5911c5314f6, State: Running, Role: LEADER
I20260811 07:07:49.427000 21481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725edd273bd047188465d5911c5314f6" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46215 } }
I20260811 07:07:49.427647 21474 sys_catalog.cc:564] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:49.430001 21483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 725edd273bd047188465d5911c5314f6. Latest consensus state: current_term: 1 leader_uuid: "725edd273bd047188465d5911c5314f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725edd273bd047188465d5911c5314f6" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46215 } } }
I20260811 07:07:49.430517 21483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:49.431469 21491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:49.431356 21482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "725edd273bd047188465d5911c5314f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725edd273bd047188465d5911c5314f6" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 46215 } } }
I20260811 07:07:49.433197 21482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:49.436684 21491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:49.445838 21491 catalog_manager.cc:1347] Generated new cluster ID: 4b4532391ef643b18fca330b907f495f
I20260811 07:07:49.445976 21491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:49.465292 21491 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:07:49.466651 21491 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:49.479805 21491 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6: Generated new TSK 0
I20260811 07:07:49.480882 21491 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:07:49.491885 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.65:0
--local_ip_for_outbound_sockets=127.30.73.65
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:46215
--builtin_ntp_servers=127.30.73.84:44523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:07:49.851191 21502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:49.851502 21502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:49.851599 21502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:49.859184 21502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:49.859308 21502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:49.859416 21502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.65
I20260811 07:07:49.869609 21502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.73.65
--webserver_port=0
--tserver_master_addrs=127.30.73.126:46215
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.65
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:49.870960 21502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:49.872907 21502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:49.887846 21510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:49.888068 21512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:49.888092 21509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:49.889484 21502 server_base.cc:1034] running on GCE node
I20260811 07:07:49.890290 21502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:49.891309 21502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:49.892573 21502 hybrid_clock.cc:648] HybridClock initialized: now 1786432069892535 us; error 47 us; skew 500 ppm
I20260811 07:07:49.892949 21502 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:49.895552 21502 webserver.cc:460] Webserver started at http://127.30.73.65:42455/ using document root <none> and password file <none>
I20260811 07:07:49.896297 21502 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:49.896440 21502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:49.896780 21502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:49.900223 21502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/data/instance:
uuid: "d62c15a23a4249bd918782c674427d21"
format_stamp: "Formatted at 2026-08-11 07:07:49 on dist-test-slave-69rg"
server_key: "9ad655d22a32a06528b357db9231ac00"
server_key_iv: "3436af65eb6847086f47f1a360b6c144"
server_key_version: "encryptionkey@0"
I20260811 07:07:49.901180 21502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance:
uuid: "d62c15a23a4249bd918782c674427d21"
format_stamp: "Formatted at 2026-08-11 07:07:49 on dist-test-slave-69rg"
server_key: "9ad655d22a32a06528b357db9231ac00"
server_key_iv: "3436af65eb6847086f47f1a360b6c144"
server_key_version: "encryptionkey@0"
I20260811 07:07:49.907783 21502 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.008s
I20260811 07:07:49.911976 21519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:49.913580 21502 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:07:49.913807 21502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/wal
uuid: "d62c15a23a4249bd918782c674427d21"
format_stamp: "Formatted at 2026-08-11 07:07:49 on dist-test-slave-69rg"
server_key: "9ad655d22a32a06528b357db9231ac00"
server_key_iv: "3436af65eb6847086f47f1a360b6c144"
server_key_version: "encryptionkey@0"
I20260811 07:07:49.914132 21502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:49.935774 21502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:49.936655 21502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:49.937000 21502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:49.938198 21502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:49.939740 21502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:49.939854 21502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:49.939987 21502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:49.940066 21502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:49.972309 21502 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.65:43383
I20260811 07:07:49.972416 21653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.65:43383 every 8 connection(s)
I20260811 07:07:49.973709 21502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/data/info.pb
I20260811 07:07:49.976202 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 21502
I20260811 07:07:49.976420 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/wal/instance
I20260811 07:07:49.977010 31013 external_mini_cluster.cc:1428] Setting key b0fc7ff800188a4f02997df1b81b862a
I20260811 07:07:49.980197 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.66:0
--local_ip_for_outbound_sockets=127.30.73.66
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:46215
--builtin_ntp_servers=127.30.73.84:44523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:07:49.989204 21656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:49.976555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.65:41939 (local address 127.30.73.126:46215)
0811 07:07:49.977085 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:49.977092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:49.978394 (+ 1302us) server_negotiation.cc:407] Connection header received
0811 07:07:49.981090 (+ 2696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:49.981095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:49.981166 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:49.981268 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:49.982849 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:49.983602 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:49.986136 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:49.986552 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:49.986665 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:49.988372 (+ 1707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:49.988378 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:49.988381 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:49.988402 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:49.988457 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:49.988469 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:49.988537 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:49.988849 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 07:07:49.988936 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":254,"threads_started":1}
I20260811 07:07:49.990686 21658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:49.977116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:46215 (local address 127.30.73.65:41939)
0811 07:07:49.978240 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:49.978289 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:49.980756 (+ 2467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:49.981553 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:49.981568 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:49.981694 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:49.982623 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:49.982655 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:49.983776 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:49.983784 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:49.985978 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:49.985998 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:49.986803 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:49.986813 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:49.987153 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:49.987956 (+ 803us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:07:49.987962 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:49.988016 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:07:49.988133 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:49.988572 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:49.988587 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:49.988599 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 07:07:49.988808 (+ 209us) client_negotiation.cc:240] Negotiation successful
0811 07:07:49.989254 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":338,"threads_started":1}
I20260811 07:07:49.992311 21654 heartbeater.cc:347] Connected to a master server at 127.30.73.126:46215
I20260811 07:07:49.992646 21654 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:49.993433 21654 heartbeater.cc:511] Master 127.30.73.126:46215 requested a full tablet report, sending...
I20260811 07:07:49.995594 21434 ts_manager.cc:194] Registered new tserver with Master: d62c15a23a4249bd918782c674427d21 (127.30.73.65:43383)
I20260811 07:07:49.997110 21434 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.65:41939
W20260811 07:07:50.342320 21659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:50.342687 21659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:50.342849 21659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:50.350924 21659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:50.351064 21659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:50.351243 21659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.66
I20260811 07:07:50.360877 21659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.73.66
--webserver_port=0
--tserver_master_addrs=127.30.73.126:46215
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.66
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:50.362329 21659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:50.364146 21659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:50.378343 21664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:50.378410 21665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:50.378378 21667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:50.379194 21659 server_base.cc:1034] running on GCE node
I20260811 07:07:50.379833 21659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:50.380897 21659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:50.382148 21659 hybrid_clock.cc:648] HybridClock initialized: now 1786432070382094 us; error 46 us; skew 500 ppm
I20260811 07:07:50.382499 21659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:50.385057 21659 webserver.cc:460] Webserver started at http://127.30.73.66:38103/ using document root <none> and password file <none>
I20260811 07:07:50.385860 21659 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:50.386015 21659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:50.386360 21659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:50.389285 21659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/data/instance:
uuid: "9f23dc74f3774ec79a195f8b73977492"
format_stamp: "Formatted at 2026-08-11 07:07:50 on dist-test-slave-69rg"
server_key: "24c2bb87ea3d1c0c327974e458b464dc"
server_key_iv: "01d0235831df41cb19203aeb26429522"
server_key_version: "encryptionkey@0"
I20260811 07:07:50.390199 21659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance:
uuid: "9f23dc74f3774ec79a195f8b73977492"
format_stamp: "Formatted at 2026-08-11 07:07:50 on dist-test-slave-69rg"
server_key: "24c2bb87ea3d1c0c327974e458b464dc"
server_key_iv: "01d0235831df41cb19203aeb26429522"
server_key_version: "encryptionkey@0"
I20260811 07:07:50.395752 21659 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:07:50.399619 21675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:50.401046 21659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:07:50.401247 21659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/wal
uuid: "9f23dc74f3774ec79a195f8b73977492"
format_stamp: "Formatted at 2026-08-11 07:07:50 on dist-test-slave-69rg"
server_key: "24c2bb87ea3d1c0c327974e458b464dc"
server_key_iv: "01d0235831df41cb19203aeb26429522"
server_key_version: "encryptionkey@0"
I20260811 07:07:50.401448 21659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:50.429374 21659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:50.430399 21659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:50.430763 21659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:50.431919 21659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:50.433682 21659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:50.433808 21659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:50.433976 21659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:50.434087 21659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:50.473299 21659 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.66:39759
I20260811 07:07:50.473412 21799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.66:39759 every 8 connection(s)
I20260811 07:07:50.474795 21659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/data/info.pb
I20260811 07:07:50.478166 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 21659
I20260811 07:07:50.478360 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/wal/instance
I20260811 07:07:50.478835 31013 external_mini_cluster.cc:1428] Setting key 0ee891adc017362618535ece729e4ef6
I20260811 07:07:50.482031 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.73.67:0
--local_ip_for_outbound_sockets=127.30.73.67
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:46215
--builtin_ntp_servers=127.30.73.84:44523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:07:50.489540 21656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:50.477940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.66:43411 (local address 127.30.73.126:46215)
0811 07:07:50.478202 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:50.478209 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:50.479954 (+ 1745us) server_negotiation.cc:407] Connection header received
0811 07:07:50.482221 (+ 2267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:50.482228 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:50.482326 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:50.482443 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:50.483779 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:50.484963 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:50.486636 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:50.487057 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:50.487206 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:50.488667 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:50.488671 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:50.488675 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:50.488694 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:50.488729 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:50.488742 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:50.488842 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:50.489078 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 07:07:50.489187 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 07:07:50.490628 21802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:50.478519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:46215 (local address 127.30.73.66:43411)
0811 07:07:50.479772 (+ 1253us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:50.479833 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:50.481917 (+ 2084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:50.482824 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:50.482836 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:50.482971 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:50.483590 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:50.483607 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:50.485130 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:50.485133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:50.486484 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:50.486497 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:50.487310 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:50.487318 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:50.487556 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:50.488319 (+ 763us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:07:50.488322 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:50.488363 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:07:50.488450 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:50.488844 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:50.488858 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:50.488867 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 07:07:50.489063 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 07:07:50.489483 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":396,"threads_started":1}
I20260811 07:07:50.492367 21800 heartbeater.cc:347] Connected to a master server at 127.30.73.126:46215
I20260811 07:07:50.492720 21800 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:50.493547 21800 heartbeater.cc:511] Master 127.30.73.126:46215 requested a full tablet report, sending...
I20260811 07:07:50.495121 21434 ts_manager.cc:194] Registered new tserver with Master: 9f23dc74f3774ec79a195f8b73977492 (127.30.73.66:39759)
I20260811 07:07:50.495976 21434 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.66:43411
W20260811 07:07:50.847229 21803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:50.847565 21803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:50.847736 21803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:50.856303 21803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:50.856420 21803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:50.856594 21803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.73.67
I20260811 07:07:50.866135 21803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.73.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.73.67
--webserver_port=0
--tserver_master_addrs=127.30.73.126:46215
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.73.67
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:50.867594 21803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:50.869539 21803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:50.883351 21811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:50.883395 21808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:50.883395 21809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:50.884259 21803 server_base.cc:1034] running on GCE node
I20260811 07:07:50.884913 21803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:50.886055 21803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:50.887351 21803 hybrid_clock.cc:648] HybridClock initialized: now 1786432070887255 us; error 79 us; skew 500 ppm
I20260811 07:07:50.887712 21803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 07:07:50.890089 21803 webserver.cc:460] Webserver started at http://127.30.73.67:42747/ using document root <none> and password file <none>
I20260811 07:07:50.890841 21803 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:50.890939 21803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:50.891304 21803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:50.894290 21803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/data/instance:
uuid: "793d3641a81741f0ac969dd1b6dad4b1"
format_stamp: "Formatted at 2026-08-11 07:07:50 on dist-test-slave-69rg"
server_key: "fa2b20ef336eda47d20bc7e230a38e1b"
server_key_iv: "a8f9fc2c472c220b2715fed3c38c3a02"
server_key_version: "encryptionkey@0"
I20260811 07:07:50.895098 21803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance:
uuid: "793d3641a81741f0ac969dd1b6dad4b1"
format_stamp: "Formatted at 2026-08-11 07:07:50 on dist-test-slave-69rg"
server_key: "fa2b20ef336eda47d20bc7e230a38e1b"
server_key_iv: "a8f9fc2c472c220b2715fed3c38c3a02"
server_key_version: "encryptionkey@0"
I20260811 07:07:50.900343 21803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 07:07:50.904006 21817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:50.905455 21803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:07:50.905622 21803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/wal
uuid: "793d3641a81741f0ac969dd1b6dad4b1"
format_stamp: "Formatted at 2026-08-11 07:07:50 on dist-test-slave-69rg"
server_key: "fa2b20ef336eda47d20bc7e230a38e1b"
server_key_iv: "a8f9fc2c472c220b2715fed3c38c3a02"
server_key_version: "encryptionkey@0"
I20260811 07:07:50.905927 21803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:50.922785 21803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:50.923635 21803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:50.923909 21803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:50.924929 21803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:07:50.926518 21803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:07:50.926652 21803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:50.926777 21803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:07:50.926842 21803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:50.963546 21803 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.67:43559
I20260811 07:07:50.963596 21952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.67:43559 every 8 connection(s)
I20260811 07:07:50.964897 21803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/data/info.pb
I20260811 07:07:50.967823 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 21803
I20260811 07:07:50.968003 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/wal/instance
I20260811 07:07:50.968466 31013 external_mini_cluster.cc:1428] Setting key d0010ac51944f06df821edc81a89a431
I20260811 07:07:50.978933 21656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:50.967542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:53799 (local address 127.30.73.126:46215)
0811 07:07:50.967781 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:50.967788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:50.969391 (+ 1603us) server_negotiation.cc:407] Connection header received
0811 07:07:50.971212 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:50.971220 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:50.971304 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:50.971383 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:50.972805 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:50.973602 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:50.975952 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:50.976382 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:50.976485 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:50.978152 (+ 1667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:50.978158 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:50.978161 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:50.978181 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:50.978214 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:50.978226 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:50.978303 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:50.978561 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 07:07:50.978667 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 07:07:50.979820 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:50.968149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:46215 (local address 127.30.73.67:53799)
0811 07:07:50.969222 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:50.969276 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:50.970960 (+ 1684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:50.971648 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:50.971659 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:50.971771 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:07:50.972599 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:50.972625 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:50.973780 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:50.973786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:50.975789 (+ 2003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:50.975804 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:50.976626 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:50.976634 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:50.976932 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:50.977728 (+ 796us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:07:50.977732 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:07:50.977782 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:07:50.977911 (+ 129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:07:50.978323 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:07:50.978332 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:07:50.978337 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:07:50.978476 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 07:07:50.978762 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":368,"threads_started":1}
I20260811 07:07:50.981302 21953 heartbeater.cc:347] Connected to a master server at 127.30.73.126:46215
I20260811 07:07:50.981642 21953 heartbeater.cc:464] Registering TS with master...
I20260811 07:07:50.982681 21953 heartbeater.cc:511] Master 127.30.73.126:46215 requested a full tablet report, sending...
I20260811 07:07:50.984426 21434 ts_manager.cc:194] Registered new tserver with Master: 793d3641a81741f0ac969dd1b6dad4b1 (127.30.73.67:43559)
I20260811 07:07:50.985265 21434 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.73.67:53799
I20260811 07:07:50.996443 31013 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:07:51.000334 21654 heartbeater.cc:503] Master 127.30.73.126:46215 was elected leader, sending a full tablet report...
I20260811 07:07:51.007266 21656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.000978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56554 (local address 127.30.73.126:46215)
0811 07:07:51.001210 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.001217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.001607 (+ 390us) server_negotiation.cc:407] Connection header received
0811 07:07:51.001759 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.001763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.001899 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.001988 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:51.002557 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.003292 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.004723 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.005153 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.005333 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.006499 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:51.006507 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:51.006516 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:51.006536 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:51.006570 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:51.006583 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:51.006660 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.006806 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.006887 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:07:51.011435 21434 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:07:51.018564 21434 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:07:51.056273 21970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.044512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:43383 (local address 127.0.0.1:57882)
0811 07:07:51.045723 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:51.045747 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:51.045936 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:51.047633 (+ 1697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:51.047646 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:51.047693 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:51.048160 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.048174 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.050314 (+ 2140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.050319 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.053212 (+ 2893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.053235 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.055320 (+ 2085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.055329 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.055525 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.055589 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 07:07:51.055731 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 07:07:51.055922 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":990,"thread_start_us":835,"threads_started":1}
I20260811 07:07:51.056370 21971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.044784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57882 (local address 127.30.73.65:43383)
0811 07:07:51.046708 (+ 1924us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.046724 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.046770 (+ 46us) server_negotiation.cc:407] Connection header received
0811 07:07:51.046911 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.046924 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.047294 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.047666 (+ 372us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:51.048371 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.050067 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.053470 (+ 3403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.055090 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.055239 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.055527 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.055805 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.056000 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1621,"thread_start_us":1422,"threads_started":1}
I20260811 07:07:51.057269 21968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.031863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.67:43559 (local address 127.0.0.1:35632)
0811 07:07:51.044890 (+ 13027us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:51.044915 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:51.045070 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:51.049403 (+ 4333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:51.049408 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:51.049436 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:51.049762 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.049773 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.051789 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.051795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.054235 (+ 2440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.054250 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.056458 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.056467 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.056653 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.056689 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:07:51.056761 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 07:07:51.056899 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12838,"mutex_wait_us":26,"thread_start_us":11573,"threads_started":1}
I20260811 07:07:51.058128 21969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.032596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35632 (local address 127.30.73.67:43559)
0811 07:07:51.048664 (+ 16068us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.048675 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.048719 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:07:51.048844 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.048855 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.049150 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.049422 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:51.050008 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.051624 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.054804 (+ 3180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.056220 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.057139 (+ 919us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.057409 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.057518 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.057721 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15822,"thread_start_us":16339,"threads_started":1}
I20260811 07:07:51.058581 21966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.031674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39759 (local address 127.0.0.1:55986)
0811 07:07:51.043921 (+ 12247us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:51.043982 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:51.044193 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:51.050809 (+ 6616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:51.050814 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:51.050848 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:51.051313 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.051328 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.053447 (+ 2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.053452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.055668 (+ 2216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.055683 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.057719 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.057725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.057931 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.057965 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:07:51.058034 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:07:51.058220 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11924,"mutex_wait_us":26,"thread_start_us":12690,"threads_started":1}
I20260811 07:07:51.059393 21967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.031855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55986 (local address 127.30.73.66:39759)
0811 07:07:51.050190 (+ 18335us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.050201 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.050231 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:07:51.050341 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.050349 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.050574 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.051521 (+ 947us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:51.051781 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.053279 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.055934 (+ 2655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.057474 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.058451 (+ 977us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.058713 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.058790 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.059060 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18142,"thread_start_us":18028,"threads_started":1}
I20260811 07:07:51.060806 21579 tablet_service.cc:1467] Processing CreateTablet for tablet 3294dce1768a4820abe7bdbfc61a530d (DEFAULT_TABLE table=test-table [id=424eb2e062e741fab5fff1e29e6c7a78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:51.062397 21579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3294dce1768a4820abe7bdbfc61a530d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:51.062506 21725 tablet_service.cc:1467] Processing CreateTablet for tablet 3294dce1768a4820abe7bdbfc61a530d (DEFAULT_TABLE table=test-table [id=424eb2e062e741fab5fff1e29e6c7a78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:51.063871 21725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3294dce1768a4820abe7bdbfc61a530d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:51.064361 21874 tablet_service.cc:1467] Processing CreateTablet for tablet 3294dce1768a4820abe7bdbfc61a530d (DEFAULT_TABLE table=test-table [id=424eb2e062e741fab5fff1e29e6c7a78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:07:51.065734 21874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3294dce1768a4820abe7bdbfc61a530d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:51.073642 21972 tablet_bootstrap.cc:492] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: Bootstrap starting.
I20260811 07:07:51.077322 21972 tablet_bootstrap.cc:654] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:51.078730 21973 tablet_bootstrap.cc:492] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: Bootstrap starting.
I20260811 07:07:51.078794 21972 log.cc:824] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:51.080555 21975 tablet_bootstrap.cc:492] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: Bootstrap starting.
I20260811 07:07:51.083181 21973 tablet_bootstrap.cc:654] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:51.084148 21975 tablet_bootstrap.cc:654] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:51.084633 21973 log.cc:824] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:51.085009 21972 tablet_bootstrap.cc:492] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: No bootstrap required, opened a new log
I20260811 07:07:51.085311 21975 log.cc:824] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:51.085395 21972 ts_tablet_manager.cc:1397] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.004s
I20260811 07:07:51.088270 21973 tablet_bootstrap.cc:492] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: No bootstrap required, opened a new log
I20260811 07:07:51.088572 21973 ts_tablet_manager.cc:1397] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 07:07:51.088598 21975 tablet_bootstrap.cc:492] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: No bootstrap required, opened a new log
I20260811 07:07:51.088865 21975 ts_tablet_manager.cc:1397] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260811 07:07:51.093999 21972 raft_consensus.cc:348] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } }
I20260811 07:07:51.094549 21972 raft_consensus.cc:374] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:51.094663 21972 raft_consensus.cc:729] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62c15a23a4249bd918782c674427d21, State: Initialized, Role: FOLLOWER
I20260811 07:07:51.095497 21972 consensus_queue.cc:260] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } }
I20260811 07:07:51.097551 21972 ts_tablet_manager.cc:1428] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260811 07:07:51.100006 21973 raft_consensus.cc:348] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } }
I20260811 07:07:51.100003 21975 raft_consensus.cc:348] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } }
I20260811 07:07:51.100487 21973 raft_consensus.cc:374] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:51.100602 21973 raft_consensus.cc:729] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f23dc74f3774ec79a195f8b73977492, State: Initialized, Role: FOLLOWER
I20260811 07:07:51.100891 21975 raft_consensus.cc:374] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:51.101042 21975 raft_consensus.cc:729] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 793d3641a81741f0ac969dd1b6dad4b1, State: Initialized, Role: FOLLOWER
I20260811 07:07:51.101516 21973 consensus_queue.cc:260] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } }
I20260811 07:07:51.101588 21975 consensus_queue.cc:260] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } }
I20260811 07:07:51.103518 21800 heartbeater.cc:503] Master 127.30.73.126:46215 was elected leader, sending a full tablet report...
I20260811 07:07:51.103590 21975 ts_tablet_manager.cc:1428] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260811 07:07:51.103885 21973 ts_tablet_manager.cc:1428] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260811 07:07:51.104059 21953 heartbeater.cc:503] Master 127.30.73.126:46215 was elected leader, sending a full tablet report...
I20260811 07:07:51.145494 21980 raft_consensus.cc:482] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:07:51.145920 21980 raft_consensus.cc:504] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } }
I20260811 07:07:51.147835 21980 leader_election.cc:288] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f23dc74f3774ec79a195f8b73977492 (127.30.73.66:39759), d62c15a23a4249bd918782c674427d21 (127.30.73.65:43383)
I20260811 07:07:51.155611 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.148333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.65:43383 (local address 127.30.73.67:38405)
0811 07:07:51.148654 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:51.148678 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:51.148851 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:51.149320 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:51.149327 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:51.149357 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:51.149531 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.149539 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.150900 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.150904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.153079 (+ 2175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.153095 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.154766 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.154771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.154936 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.154975 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 07:07:51.155081 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 07:07:51.155287 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":5}
I20260811 07:07:51.155622 21971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.148480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:38405 (local address 127.30.73.65:43383)
0811 07:07:51.148683 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.148690 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.148917 (+ 227us) server_negotiation.cc:407] Connection header received
0811 07:07:51.149015 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.149023 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.149134 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.149258 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:51.149718 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.150768 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.153266 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.154552 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.154738 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.154818 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.155205 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.155340 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:07:51.155927 21967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.148416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.73.67:59839 (local address 127.30.73.66:39759)
0811 07:07:51.148845 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.148855 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.149241 (+ 386us) server_negotiation.cc:407] Connection header received
0811 07:07:51.149459 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.149464 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.149523 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.149605 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:07:51.150213 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.151120 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.153547 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.154865 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.155040 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.155104 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.155492 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.155624 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229}
I20260811 07:07:51.156563 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.148373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.66:39759 (local address 127.30.73.67:59839)
0811 07:07:51.149131 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0811 07:07:51.149144 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:07:51.149287 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:07:51.149652 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:07:51.149664 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:07:51.149697 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:07:51.150038 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.150047 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.151268 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.151273 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.153352 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:07:51.153362 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.155049 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.155056 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:07:51.155297 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.155330 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:07:51.156178 (+ 848us) client_negotiation.cc:240] Negotiation successful
0811 07:07:51.156323 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"mutex_wait_us":30,"thread_start_us":471,"threads_started":1}
I20260811 07:07:51.157025 21604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3294dce1768a4820abe7bdbfc61a530d" candidate_uuid: "793d3641a81741f0ac969dd1b6dad4b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c15a23a4249bd918782c674427d21" is_pre_election: true
I20260811 07:07:51.157608 21750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3294dce1768a4820abe7bdbfc61a530d" candidate_uuid: "793d3641a81741f0ac969dd1b6dad4b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f23dc74f3774ec79a195f8b73977492" is_pre_election: true
I20260811 07:07:51.157742 21604 raft_consensus.cc:2454] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 793d3641a81741f0ac969dd1b6dad4b1 in term 0.
I20260811 07:07:51.158222 21750 raft_consensus.cc:2454] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 793d3641a81741f0ac969dd1b6dad4b1 in term 0.
I20260811 07:07:51.158640 21821 leader_election.cc:302] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 793d3641a81741f0ac969dd1b6dad4b1, d62c15a23a4249bd918782c674427d21; no voters:
I20260811 07:07:51.159080 21980 raft_consensus.cc:2781] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:07:51.159238 21980 raft_consensus.cc:482] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:07:51.159346 21980 raft_consensus.cc:3037] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:51.161527 21980 raft_consensus.cc:504] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } }
I20260811 07:07:51.162214 21980 leader_election.cc:288] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [CANDIDATE]: Term 1 election: Requested vote from peers 9f23dc74f3774ec79a195f8b73977492 (127.30.73.66:39759), d62c15a23a4249bd918782c674427d21 (127.30.73.65:43383)
I20260811 07:07:51.162721 21750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3294dce1768a4820abe7bdbfc61a530d" candidate_uuid: "793d3641a81741f0ac969dd1b6dad4b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f23dc74f3774ec79a195f8b73977492"
I20260811 07:07:51.162779 21604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3294dce1768a4820abe7bdbfc61a530d" candidate_uuid: "793d3641a81741f0ac969dd1b6dad4b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62c15a23a4249bd918782c674427d21"
I20260811 07:07:51.162919 21750 raft_consensus.cc:3037] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:51.163064 21604 raft_consensus.cc:3037] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:51.165261 21750 raft_consensus.cc:2454] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 793d3641a81741f0ac969dd1b6dad4b1 in term 1.
I20260811 07:07:51.165462 21604 raft_consensus.cc:2454] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 793d3641a81741f0ac969dd1b6dad4b1 in term 1.
I20260811 07:07:51.165735 21818 leader_election.cc:302] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 793d3641a81741f0ac969dd1b6dad4b1, 9f23dc74f3774ec79a195f8b73977492; no voters:
I20260811 07:07:51.166105 21980 raft_consensus.cc:2781] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:51.166584 21980 raft_consensus.cc:686] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 1 LEADER]: Becoming Leader. State: Replica: 793d3641a81741f0ac969dd1b6dad4b1, State: Running, Role: LEADER
I20260811 07:07:51.167064 21980 consensus_queue.cc:237] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } }
I20260811 07:07:51.172333 21434 catalog_manager.cc:5495] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 793d3641a81741f0ac969dd1b6dad4b1 (127.30.73.67). New cstate: current_term: 1 leader_uuid: "793d3641a81741f0ac969dd1b6dad4b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "793d3641a81741f0ac969dd1b6dad4b1" member_type: VOTER last_known_addr { host: "127.30.73.67" port: 43559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 } health_report { overall_health: UNKNOWN } } }
I20260811 07:07:51.199523 21969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.193703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35636 (local address 127.30.73.67:43559)
0811 07:07:51.193943 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.193951 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.194019 (+ 68us) server_negotiation.cc:407] Connection header received
0811 07:07:51.194332 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.194337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.194422 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.194599 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:07:51.194989 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.195761 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.197189 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.197660 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.197806 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.198372 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:07:51.198901 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:07:51.199082 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.199168 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.199250 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:07:51.208896 21750 raft_consensus.cc:1261] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [term 1 FOLLOWER]: Refusing update from remote peer 793d3641a81741f0ac969dd1b6dad4b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:51.209288 21604 raft_consensus.cc:1261] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [term 1 FOLLOWER]: Refusing update from remote peer 793d3641a81741f0ac969dd1b6dad4b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:07:51.210065 21983 consensus_queue.cc:1035] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f23dc74f3774ec79a195f8b73977492" member_type: VOTER last_known_addr { host: "127.30.73.66" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:07:51.210552 21980 consensus_queue.cc:1035] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62c15a23a4249bd918782c674427d21" member_type: VOTER last_known_addr { host: "127.30.73.65" port: 43383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:07:51.216612 21954 tablet.cc:2369] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:07:51.227157 21801 tablet.cc:2369] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:07:51.242074 21433 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:51.242405 21433 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:07:51.247633 21433 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 725edd273bd047188465d5911c5314f6: Sending DeleteTablet for 3 replicas of tablet 3294dce1768a4820abe7bdbfc61a530d
I20260811 07:07:51.249040 21725 tablet_service.cc:1514] Processing DeleteTablet for tablet 3294dce1768a4820abe7bdbfc61a530d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:51 UTC) from {username='slave'} at 127.0.0.1:55986
I20260811 07:07:51.249253 21579 tablet_service.cc:1514] Processing DeleteTablet for tablet 3294dce1768a4820abe7bdbfc61a530d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:51 UTC) from {username='slave'} at 127.0.0.1:57882
I20260811 07:07:51.249764 21874 tablet_service.cc:1514] Processing DeleteTablet for tablet 3294dce1768a4820abe7bdbfc61a530d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:07:51 UTC) from {username='slave'} at 127.0.0.1:35632
I20260811 07:07:51.252279 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 21502
I20260811 07:07:51.262054 22000 tablet_replica.cc:330] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: stopping tablet replica
I20260811 07:07:51.262342 21999 tablet_replica.cc:330] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: stopping tablet replica
I20260811 07:07:51.262638 21998 tablet_replica.cc:330] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: stopping tablet replica
I20260811 07:07:51.262866 21999 raft_consensus.cc:2229] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:51.262933 22000 raft_consensus.cc:2229] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:07:51.263058 21998 raft_consensus.cc:2229] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:07:51.263495 21999 raft_consensus.cc:2258] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:51.263526 21998 raft_consensus.cc:2258] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:51.263972 22000 raft_consensus.cc:2258] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:07:51.266477 21999 ts_tablet_manager.cc:1905] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:51.266481 22000 ts_tablet_manager.cc:1905] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:51.269232 21998 ts_tablet_manager.cc:1905] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:07:51.273852 21999 ts_tablet_manager.cc:1918] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:51.274044 21999 log.cc:1196] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-1/wal/wals/3294dce1768a4820abe7bdbfc61a530d
I20260811 07:07:51.274634 21999 ts_tablet_manager.cc:1939] T 3294dce1768a4820abe7bdbfc61a530d P 9f23dc74f3774ec79a195f8b73977492: Deleting consensus metadata
I20260811 07:07:51.275560 22000 ts_tablet_manager.cc:1918] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:51.275862 22000 log.cc:1196] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-2/wal/wals/3294dce1768a4820abe7bdbfc61a530d
I20260811 07:07:51.276458 21998 ts_tablet_manager.cc:1918] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:07:51.276652 21998 log.cc:1196] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: Deleting WAL directory at /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786431722204153-31013-0/minicluster-data/ts-0/wal/wals/3294dce1768a4820abe7bdbfc61a530d
I20260811 07:07:51.276610 22000 ts_tablet_manager.cc:1939] T 3294dce1768a4820abe7bdbfc61a530d P 793d3641a81741f0ac969dd1b6dad4b1: Deleting consensus metadata
I20260811 07:07:51.276823 21416 catalog_manager.cc:4841] TS 9f23dc74f3774ec79a195f8b73977492 (127.30.73.66:39759): tablet 3294dce1768a4820abe7bdbfc61a530d (table test-table [id=424eb2e062e741fab5fff1e29e6c7a78]) successfully deleted
I20260811 07:07:51.277272 21998 ts_tablet_manager.cc:1939] T 3294dce1768a4820abe7bdbfc61a530d P d62c15a23a4249bd918782c674427d21: Deleting consensus metadata
I20260811 07:07:51.279305 21419 catalog_manager.cc:4841] TS 793d3641a81741f0ac969dd1b6dad4b1 (127.30.73.67:43559): tablet 3294dce1768a4820abe7bdbfc61a530d (table test-table [id=424eb2e062e741fab5fff1e29e6c7a78]) successfully deleted
I20260811 07:07:51.279616 21419 catalog_manager.cc:4841] TS d62c15a23a4249bd918782c674427d21 (127.30.73.65:43383): tablet 3294dce1768a4820abe7bdbfc61a530d (table test-table [id=424eb2e062e741fab5fff1e29e6c7a78]) successfully deleted
I20260811 07:07:51.284142 21971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.254529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57898 (local address 127.30.73.65:43383)
0811 07:07:51.254815 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.254824 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.266676 (+ 11852us) server_negotiation.cc:407] Connection header received
0811 07:07:51.266918 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.266923 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.267065 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.267193 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:51.278148 (+ 10955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.279244 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.280854 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.281274 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.281431 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.282674 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:51.282683 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:51.282698 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:51.283313 (+ 615us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:51.283370 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:51.283391 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:51.283525 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.283680 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.283807 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260811 07:07:51.284987 21649 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:51.405027 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 21502
I20260811 07:07:51.429071 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 21659
I20260811 07:07:51.437608 21967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.430077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56002 (local address 127.30.73.66:39759)
0811 07:07:51.430331 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.430340 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.430363 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:07:51.430432 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.430439 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.430556 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.430672 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:51.431095 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.432298 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.434031 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.434705 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.434856 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.435955 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:51.435970 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:51.435994 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:51.436771 (+ 777us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:51.436845 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:51.436871 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:51.436996 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.437130 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.437241 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 07:07:51.438488 21795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:51.533088 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 21659
I20260811 07:07:51.557327 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 21803
I20260811 07:07:51.564936 21969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:51.558237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35646 (local address 127.30.73.67:43559)
0811 07:07:51.558707 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:51.558712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:51.558728 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:07:51.558805 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:51.558809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:51.558889 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:51.559017 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:51.559478 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.560275 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.561550 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:51.562192 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:51.562358 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:51.563511 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:51.563520 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:51.563535 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:51.564164 (+ 629us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:51.564210 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:51.564229 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:51.564365 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:51.564506 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 07:07:51.564604 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344}
I20260811 07:07:51.565975 21947 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:51.687304 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 21803
I20260811 07:07:51.714278 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 21398
I20260811 07:07:51.715498 21469 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:51.827014 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 21398
2026-08-11T07:07:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3021 ms)
[----------] 6 tests from EncryptionPolicyTest (25419 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:07:51 dist-test-slave-69rg krb5kdc[22011](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:07:51 dist-test-slave-69rg krb5kdc[22011](info): set up 2 sockets
Aug 11 07:07:51 dist-test-slave-69rg krb5kdc[22011](info): commencing operation
krb5kdc: starting...
W20260811 07:07:53.114624 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:07:53 dist-test-slave-69rg krb5kdc[22011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:07:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:07:53.450796 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34671
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:53.800727 22027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:53.801100 22027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:53.801273 22027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:53.808971 22027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:53.809157 22027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:53.809289 22027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:53.809417 22027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:53.809507 22027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:53.820910 22027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34671
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:53.822440 22027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:53.823794 22027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:53.836488 22032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:53.836303 22033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:53.836544 22035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:53.837523 22027 server_base.cc:1034] running on GCE node
I20260811 07:07:53.838406 22027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:53.839808 22027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:53.841058 22027 hybrid_clock.cc:648] HybridClock initialized: now 1786432073841017 us; error 58 us; skew 500 ppm
I20260811 07:07:53.841425 22027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:53 dist-test-slave-69rg krb5kdc[22011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432073, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:53.848897 22027 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:07:53.850620 22027 webserver.cc:460] Webserver started at http://127.0.0.1:41665/ using document root <none> and password file <none>
I20260811 07:07:53.851351 22027 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:53.851522 22027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:53.851863 22027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:53.855079 22027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "544199ffa9ed47e586609399e3db20f0"
format_stamp: "Formatted at 2026-08-11 07:07:53 on dist-test-slave-69rg"
server_key: "9f2047ed336e6a9cfda45f6529e44ea4"
server_key_iv: "892bdf78070bd1aaa04373078ac862cf"
server_key_version: "encryptionkey@0"
I20260811 07:07:53.855914 22027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "544199ffa9ed47e586609399e3db20f0"
format_stamp: "Formatted at 2026-08-11 07:07:53 on dist-test-slave-69rg"
server_key: "9f2047ed336e6a9cfda45f6529e44ea4"
server_key_iv: "892bdf78070bd1aaa04373078ac862cf"
server_key_version: "encryptionkey@0"
I20260811 07:07:53.861454 22027 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 07:07:53.865247 22045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:53.866870 22027 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:07:53.867097 22027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "544199ffa9ed47e586609399e3db20f0"
format_stamp: "Formatted at 2026-08-11 07:07:53 on dist-test-slave-69rg"
server_key: "9f2047ed336e6a9cfda45f6529e44ea4"
server_key_iv: "892bdf78070bd1aaa04373078ac862cf"
server_key_version: "encryptionkey@0"
I20260811 07:07:53.867350 22027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:53.887377 22027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:53.892540 22027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:53.892882 22027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:53.915223 22027 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34671
I20260811 07:07:53.915329 22106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34671 every 8 connection(s)
I20260811 07:07:53.916831 22027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:53.920897 22108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:53.924393 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 22027
I20260811 07:07:53.924610 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:07:53.925485 31013 external_mini_cluster.cc:1428] Setting key b50a6dc7194440b6d78e754f03ce648e
I20260811 07:07:53.934526 22108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0: Bootstrap starting.
I20260811 07:07:53.938513 22108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:53.939946 22108 log.cc:824] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:07:53 dist-test-slave-69rg krb5kdc[22011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:07:53.943706 22108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0: No bootstrap required, opened a new log
I20260811 07:07:53.950884 22111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:53.927625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36979 (local address 127.0.0.1:34671)
0811 07:07:53.928518 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:53.928531 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:53.928575 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:07:53.930425 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:53.930449 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:53.930863 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:53.931203 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:53.933017 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:53.934584 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:53.936516 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:53.937457 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:53.937609 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:53.943087 (+ 5478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:53.943095 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:53.943113 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:53.943152 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:53.946381 (+ 3229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:53.947396 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:53.947403 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:53.947410 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:53.947589 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:53.948122 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:53.948125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:53.948127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:53.948652 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:53.948926 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:53.949410 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 07:07:53.949743 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":422,"threads_started":1}
I20260811 07:07:53.952940 22108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "544199ffa9ed47e586609399e3db20f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34671 } }
I20260811 07:07:53.953325 22108 raft_consensus.cc:374] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:53.953451 22108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544199ffa9ed47e586609399e3db20f0, State: Initialized, Role: FOLLOWER
I20260811 07:07:53.954129 22108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "544199ffa9ed47e586609399e3db20f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34671 } }
I20260811 07:07:53.954429 22108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:53.954589 22108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:53.954789 22108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:53.955202 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:07:53.958107 22108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "544199ffa9ed47e586609399e3db20f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34671 } }
I20260811 07:07:53.958731 22108 leader_election.cc:302] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 544199ffa9ed47e586609399e3db20f0; no voters:
I20260811 07:07:53.959507 22108 leader_election.cc:288] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:07:53.959645 22114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:53.961309 22114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [term 1 LEADER]: Becoming Leader. State: Replica: 544199ffa9ed47e586609399e3db20f0, State: Running, Role: LEADER
I20260811 07:07:53.962182 22114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "544199ffa9ed47e586609399e3db20f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34671 } }
I20260811 07:07:53.962445 22108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:53.967717 22118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "544199ffa9ed47e586609399e3db20f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "544199ffa9ed47e586609399e3db20f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34671 } } }
I20260811 07:07:53.968107 22118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:53.968716 22119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 544199ffa9ed47e586609399e3db20f0. Latest consensus state: current_term: 1 leader_uuid: "544199ffa9ed47e586609399e3db20f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "544199ffa9ed47e586609399e3db20f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34671 } } }
I20260811 07:07:53.969148 22119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:53.975809 22127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:53.980973 22127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:53.986907 22111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:53.961956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52171 (local address 127.0.0.1:34671)
0811 07:07:53.962107 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:53.962113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:53.962693 (+ 580us) server_negotiation.cc:407] Connection header received
0811 07:07:53.962961 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:53.962967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:53.963045 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:53.963166 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:53.965609 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:53.967324 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:53.969567 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:53.974092 (+ 4525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:53.974269 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:53.978406 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:53.978420 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:53.978427 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:07:53.978483 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:53.982739 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:53.983769 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:53.983774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:53.983778 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:53.983950 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:07:53.984523 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:07:53.984528 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:07:53.984531 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:07:53.984974 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:53.985266 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:53.986390 (+ 1124us) server_negotiation.cc:299] Negotiation successful
0811 07:07:53.986580 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 07:07:53.992348 22127 catalog_manager.cc:1347] Generated new cluster ID: 5d627ebb853746758a424fea14d52fb6
I20260811 07:07:53.992476 22127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:54.001439 22127 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:07:54.003080 22127 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:54.012310 22127 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 544199ffa9ed47e586609399e3db20f0: Generated new TSK 0
I20260811 07:07:54.013265 22127 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:07:54.021603 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22027
I20260811 07:07:54.022841 22100 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:07:54.117725 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 22027
W20260811 07:07:54.139745 22009 connection.cc:535] client connection to 127.0.0.1:34671 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34671): Connection reset by peer (error 104)
2026-08-11T07:07:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2278 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:07:54 dist-test-slave-69rg krb5kdc[22148](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:07:54 dist-test-slave-69rg krb5kdc[22148](info): set up 2 sockets
Aug 11 07:07:54 dist-test-slave-69rg krb5kdc[22148](info): commencing operation
krb5kdc: starting...
W20260811 07:07:55.331954 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:07:55 dist-test-slave-69rg krb5kdc[22148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:07:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:07:55.663509 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40411
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40411
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:56.013324 22161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:56.013674 22161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:56.013887 22161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:56.021231 22161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:56.021394 22161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:56.021502 22161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:56.021620 22161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:56.021711 22161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:56.031823 22161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40411
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:56.033210 22161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:56.034618 22161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:56.047930 22169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:56.048033 22168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:56.048372 22171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:56.049484 22161 server_base.cc:1034] running on GCE node
I20260811 07:07:56.050410 22161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:56.051889 22161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:56.053105 22161 hybrid_clock.cc:648] HybridClock initialized: now 1786432076053063 us; error 35 us; skew 500 ppm
I20260811 07:07:56.053501 22161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:56 dist-test-slave-69rg krb5kdc[22148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432076, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:56.057070 22161 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:07:56.058818 22161 webserver.cc:460] Webserver started at http://127.0.0.1:42661/ using document root <none> and password file <none>
I20260811 07:07:56.059525 22161 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:56.059734 22161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:56.060073 22161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:56.063340 22161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "0fe73f3553e246cd93e2ac102b355fb6"
format_stamp: "Formatted at 2026-08-11 07:07:56 on dist-test-slave-69rg"
server_key: "b69293839f686ef15fd97016d4584357"
server_key_iv: "ec60e7a3063f517d140382e02e51aa43"
server_key_version: "encryptionkey@0"
I20260811 07:07:56.064479 22161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "0fe73f3553e246cd93e2ac102b355fb6"
format_stamp: "Formatted at 2026-08-11 07:07:56 on dist-test-slave-69rg"
server_key: "b69293839f686ef15fd97016d4584357"
server_key_iv: "ec60e7a3063f517d140382e02e51aa43"
server_key_version: "encryptionkey@0"
I20260811 07:07:56.072660 22161 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260811 07:07:56.076879 22178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:56.078378 22161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:07:56.078562 22161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "0fe73f3553e246cd93e2ac102b355fb6"
format_stamp: "Formatted at 2026-08-11 07:07:56 on dist-test-slave-69rg"
server_key: "b69293839f686ef15fd97016d4584357"
server_key_iv: "ec60e7a3063f517d140382e02e51aa43"
server_key_version: "encryptionkey@0"
I20260811 07:07:56.078761 22161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:56.122752 22161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:56.127321 22161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:56.127645 22161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:56.147264 22161 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40411
I20260811 07:07:56.147286 22239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40411 every 8 connection(s)
I20260811 07:07:56.148672 22161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:56.152539 22240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:56.156936 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 22161
I20260811 07:07:56.157133 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:07:56.157719 31013 external_mini_cluster.cc:1428] Setting key 9cb8b9a9b54244db75f35a3cfe72697d
I20260811 07:07:56.166606 22240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6: Bootstrap starting.
I20260811 07:07:56.170423 22240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:56.171583 22240 log.cc:824] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:56.171949 22243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:56.159718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49663 (local address 127.0.0.1:40411)
0811 07:07:56.160531 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:56.160543 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:56.160592 (+ 49us) server_negotiation.cc:407] Connection header received
0811 07:07:56.162377 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:56.162400 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:56.162840 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:56.163178 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:56.163916 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:56.165298 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:56.167284 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:56.167985 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:56.168146 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:56.169513 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:56.169520 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:56.169533 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:56.170148 (+ 615us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:56.170226 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:56.170252 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:56.170376 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:56.170761 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 07:07:56.170956 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":367,"threads_started":1}
I20260811 07:07:56.174521 22240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6: No bootstrap required, opened a new log
I20260811 07:07:56.175760 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:07:56.183029 22240 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe73f3553e246cd93e2ac102b355fb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40411 } }
I20260811 07:07:56.183521 22240 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:56.183640 22240 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe73f3553e246cd93e2ac102b355fb6, State: Initialized, Role: FOLLOWER
I20260811 07:07:56.184290 22240 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe73f3553e246cd93e2ac102b355fb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40411 } }
I20260811 07:07:56.184648 22240 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:56.184823 22240 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:56.185021 22240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:56.187479 22243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:56.180263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59893 (local address 127.0.0.1:40411)
0811 07:07:56.180460 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:56.180466 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:56.180789 (+ 323us) server_negotiation.cc:407] Connection header received
0811 07:07:56.180952 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:56.180955 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:56.181012 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:56.181089 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:56.181738 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:56.182630 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:56.184610 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:07:56.185235 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:07:56.185338 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:07:56.186571 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:56.186575 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:56.186579 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:56.186596 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:56.186652 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:56.186668 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:56.186768 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:56.187020 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 07:07:56.187154 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:07:56.188285 22240 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe73f3553e246cd93e2ac102b355fb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40411 } }
I20260811 07:07:56.188897 22240 leader_election.cc:302] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fe73f3553e246cd93e2ac102b355fb6; no voters:
I20260811 07:07:56.189567 22240 leader_election.cc:288] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:07:56.189761 22250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:56.190534 22250 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe73f3553e246cd93e2ac102b355fb6, State: Running, Role: LEADER
I20260811 07:07:56.191097 22250 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe73f3553e246cd93e2ac102b355fb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40411 } }
I20260811 07:07:56.191820 22240 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:56.195799 22253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fe73f3553e246cd93e2ac102b355fb6. Latest consensus state: current_term: 1 leader_uuid: "0fe73f3553e246cd93e2ac102b355fb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe73f3553e246cd93e2ac102b355fb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40411 } } }
I20260811 07:07:56.195772 22252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fe73f3553e246cd93e2ac102b355fb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe73f3553e246cd93e2ac102b355fb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40411 } } }
I20260811 07:07:56.196305 22252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:56.196535 22253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:56.202924 22260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:56.208377 22260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:56.217316 22260 catalog_manager.cc:1347] Generated new cluster ID: 406d981be90b4688b0d63413da886c74
I20260811 07:07:56.217490 22260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:56.240803 22260 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:07:56.242730 22260 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:56.251807 22260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fe73f3553e246cd93e2ac102b355fb6: Generated new TSK 0
I20260811 07:07:56.252630 22260 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:07:56.264070 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22161
W20260811 07:07:56.265286 22235 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49663
W20260811 07:07:56.266188 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22161: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:07:56.266381 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 22161
W20260811 07:07:56.287979 22146 connection.cc:535] client connection to 127.0.0.1:40411 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40411): Connection reset by peer (error 104)
2026-08-11T07:07:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2147 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:07:56 dist-test-slave-69rg krb5kdc[22273](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:07:56 dist-test-slave-69rg krb5kdc[22273](info): set up 2 sockets
Aug 11 07:07:56 dist-test-slave-69rg krb5kdc[22273](info): commencing operation
krb5kdc: starting...
W20260811 07:07:57.469947 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:07:57 dist-test-slave-69rg krb5kdc[22273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:07:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:07:57.801386 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32989
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:07:58.159415 22288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:07:58.159722 22288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:07:58.159826 22288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:07:58.167397 22288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:07:58.167526 22288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:07:58.167574 22288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:07:58.167632 22288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:07:58.167681 22288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:07:58.177932 22288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32989
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:07:58.179230 22288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:07:58.180514 22288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:07:58.192930 22296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:58.193023 22298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:07:58.193029 22294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:07:58.194062 22288 server_base.cc:1034] running on GCE node
I20260811 07:07:58.194789 22288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:07:58.196127 22288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:07:58.197353 22288 hybrid_clock.cc:648] HybridClock initialized: now 1786432078197299 us; error 48 us; skew 500 ppm
I20260811 07:07:58.197715 22288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:07:58 dist-test-slave-69rg krb5kdc[22273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432078, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:07:58.200999 22288 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:07:58.202646 22288 webserver.cc:460] Webserver started at http://127.0.0.1:35953/ using document root <none> and password file <none>
I20260811 07:07:58.203438 22288 fs_manager.cc:359] Metadata directory not provided
I20260811 07:07:58.203588 22288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:07:58.203891 22288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:07:58.207080 22288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "82166b4dbe554cd590d20aecb6137f54"
format_stamp: "Formatted at 2026-08-11 07:07:58 on dist-test-slave-69rg"
server_key: "819de47f021bcdab1fb272b3afa2e82f"
server_key_iv: "487c0d90c64041279935cf226c656818"
server_key_version: "encryptionkey@0"
I20260811 07:07:58.207901 22288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "82166b4dbe554cd590d20aecb6137f54"
format_stamp: "Formatted at 2026-08-11 07:07:58 on dist-test-slave-69rg"
server_key: "819de47f021bcdab1fb272b3afa2e82f"
server_key_iv: "487c0d90c64041279935cf226c656818"
server_key_version: "encryptionkey@0"
I20260811 07:07:58.213270 22288 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:07:58.216809 22305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:07:58.218358 22288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:07:58.218566 22288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "82166b4dbe554cd590d20aecb6137f54"
format_stamp: "Formatted at 2026-08-11 07:07:58 on dist-test-slave-69rg"
server_key: "819de47f021bcdab1fb272b3afa2e82f"
server_key_iv: "487c0d90c64041279935cf226c656818"
server_key_version: "encryptionkey@0"
I20260811 07:07:58.218778 22288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:07:58.224907 22288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:07:58.229265 22288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:07:58.229593 22288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:07:58.250051 22288 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32989
I20260811 07:07:58.250146 22362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32989 every 8 connection(s)
I20260811 07:07:58.251547 22288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:07:58.254329 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 22288
I20260811 07:07:58.254529 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:07:58.255029 31013 external_mini_cluster.cc:1428] Setting key abb7ce552831e781359858998588c205
I20260811 07:07:58.255734 22363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:07:58.264731 22366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:58.256858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36329 (local address 127.0.0.1:32989)
0811 07:07:58.257786 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:58.257798 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:58.258402 (+ 604us) server_negotiation.cc:407] Connection header received
0811 07:07:58.260987 (+ 2585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:58.261011 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:58.261401 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:58.261873 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:58.263055 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:58.263062 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:58.263078 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:58.263097 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:58.263162 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:58.263183 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:58.263454 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:58.263602 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 07:07:58.263787 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":412,"threads_started":1}
I20260811 07:07:58.268644 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:07:58.269549 22363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54: Bootstrap starting.
I20260811 07:07:58.272797 22363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54: Neither blocks nor log segments found. Creating new log.
I20260811 07:07:58.274263 22363 log.cc:824] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54: Log is configured to *not* fsync() on all Append() calls
I20260811 07:07:58.276485 22366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:07:58.273630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43087 (local address 127.0.0.1:32989)
0811 07:07:58.273849 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 07:07:58.273858 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:07:58.274333 (+ 475us) server_negotiation.cc:407] Connection header received
0811 07:07:58.274583 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:07:58.274588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:07:58.274638 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:07:58.274766 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:07:58.275808 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:07:58.275821 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:07:58.275825 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:07:58.275840 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:07:58.275880 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:07:58.275895 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:07:58.276020 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:07:58.276139 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 07:07:58.276200 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:07:58.277339 22363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54: No bootstrap required, opened a new log
I20260811 07:07:58.284982 22363 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82166b4dbe554cd590d20aecb6137f54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32989 } }
I20260811 07:07:58.285363 22363 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:07:58.285470 22363 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82166b4dbe554cd590d20aecb6137f54, State: Initialized, Role: FOLLOWER
I20260811 07:07:58.286069 22363 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82166b4dbe554cd590d20aecb6137f54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32989 } }
I20260811 07:07:58.286306 22363 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:07:58.286453 22363 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:07:58.286629 22363 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:07:58.288985 22363 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82166b4dbe554cd590d20aecb6137f54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32989 } }
I20260811 07:07:58.289523 22363 leader_election.cc:302] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82166b4dbe554cd590d20aecb6137f54; no voters:
I20260811 07:07:58.290143 22363 leader_election.cc:288] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:07:58.290318 22376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:07:58.291059 22376 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [term 1 LEADER]: Becoming Leader. State: Replica: 82166b4dbe554cd590d20aecb6137f54, State: Running, Role: LEADER
I20260811 07:07:58.291647 22376 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82166b4dbe554cd590d20aecb6137f54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32989 } }
I20260811 07:07:58.292296 22363 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:07:58.294525 22377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82166b4dbe554cd590d20aecb6137f54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82166b4dbe554cd590d20aecb6137f54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32989 } } }
I20260811 07:07:58.294878 22377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [sys.catalog]: This master's current role is: LEADER
I20260811 07:07:58.295641 22379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82166b4dbe554cd590d20aecb6137f54. Latest consensus state: current_term: 1 leader_uuid: "82166b4dbe554cd590d20aecb6137f54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82166b4dbe554cd590d20aecb6137f54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32989 } } }
I20260811 07:07:58.296043 22379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54 [sys.catalog]: This master's current role is: LEADER
W20260811 07:07:58.307130 22395 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:07:58.307255 22395 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:07:58.307408 22385 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:07:58.309612 22385 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:07:58.318508 22385 catalog_manager.cc:1347] Generated new cluster ID: a2c88d0f4de74c4b93963ee7d0f83c9d
I20260811 07:07:58.318634 22385 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:07:58.338696 22385 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:07:58.339182 22385 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:07:58.351859 22385 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82166b4dbe554cd590d20aecb6137f54: Generated new TSK 0
I20260811 07:07:58.353016 22385 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:07:58.363039 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22288
W20260811 07:07:58.364729 22358 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36329
W20260811 07:07:58.365480 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22288: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:07:58.365643 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 22288
2026-08-11T07:07:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2101 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:07:58 dist-test-slave-69rg krb5kdc[22401](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:07:58 dist-test-slave-69rg krb5kdc[22401](info): set up 2 sockets
Aug 11 07:07:58 dist-test-slave-69rg krb5kdc[22401](info): commencing operation
krb5kdc: starting...
W20260811 07:07:59.605631 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:07:59 dist-test-slave-69rg krb5kdc[22401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:07:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:07:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:07:59.943661 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40737
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:00.310308 22415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:00.310618 22415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:00.310715 22415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:00.318142 22415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:00.318269 22415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:00.318317 22415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:00.318373 22415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:00.318420 22415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:00.328809 22415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:00.330160 22415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:00.331455 22415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:00.344064 22422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:00.344125 22425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:00.344064 22423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:00.345033 22415 server_base.cc:1034] running on GCE node
I20260811 07:08:00.345948 22415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:00.347383 22415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:00.348605 22415 hybrid_clock.cc:648] HybridClock initialized: now 1786432080348557 us; error 34 us; skew 500 ppm
I20260811 07:08:00.348997 22415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:00 dist-test-slave-69rg krb5kdc[22401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432080, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:00.356564 22415 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:08:00.358341 22415 webserver.cc:460] Webserver started at http://127.0.0.1:37181/ using document root <none> and password file <none>
I20260811 07:08:00.359069 22415 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:00.359191 22415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:00.359459 22415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:00.362666 22415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "2cb83eac5da340d7bad789e42b2fca3c"
format_stamp: "Formatted at 2026-08-11 07:08:00 on dist-test-slave-69rg"
server_key: "28ea6748dfec68e02e1b84d3ecc4e21b"
server_key_iv: "d86197df0080d8b425f2386e8633f596"
server_key_version: "encryptionkey@0"
I20260811 07:08:00.363469 22415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "2cb83eac5da340d7bad789e42b2fca3c"
format_stamp: "Formatted at 2026-08-11 07:08:00 on dist-test-slave-69rg"
server_key: "28ea6748dfec68e02e1b84d3ecc4e21b"
server_key_iv: "d86197df0080d8b425f2386e8633f596"
server_key_version: "encryptionkey@0"
I20260811 07:08:00.368975 22415 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 07:08:00.372567 22432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:00.374040 22415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:08:00.374235 22415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "2cb83eac5da340d7bad789e42b2fca3c"
format_stamp: "Formatted at 2026-08-11 07:08:00 on dist-test-slave-69rg"
server_key: "28ea6748dfec68e02e1b84d3ecc4e21b"
server_key_iv: "d86197df0080d8b425f2386e8633f596"
server_key_version: "encryptionkey@0"
I20260811 07:08:00.374445 22415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:00.399875 22415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:00.404556 22415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:00.404887 22415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:00.425197 22415 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40737
I20260811 07:08:00.425256 22491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40737 every 8 connection(s)
I20260811 07:08:00.426606 22415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:00.427320 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 22415
I20260811 07:08:00.427522 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:00.428135 31013 external_mini_cluster.cc:1428] Setting key 02c04d62f5c642ca0431aef9c6eec831
I20260811 07:08:00.431072 22492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:08:00 dist-test-slave-69rg krb5kdc[22401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:08:00.441752 22492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c: Bootstrap starting.
I20260811 07:08:00.445061 22492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:00.446214 22492 log.cc:824] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:00.448956 22492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c: No bootstrap required, opened a new log
I20260811 07:08:00.450444 22495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:00.430048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52889 (local address 127.0.0.1:40737)
0811 07:08:00.430898 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:00.430909 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:00.430947 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:08:00.432653 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:00.432677 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:00.433026 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:00.433448 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:00.434958 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:00.436287 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:00.437515 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:00.438256 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:00.438490 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:00.442888 (+ 4398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:00.442897 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:00.442913 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:00.442955 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:00.446363 (+ 3408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:00.447091 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:00.447097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:00.447103 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:00.447277 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:00.447703 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:00.447707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:00.447709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:00.448235 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:00.448544 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:00.449000 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 07:08:00.449421 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":419,"threads_started":1}
I20260811 07:08:00.454495 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:00.457624 22492 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb83eac5da340d7bad789e42b2fca3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40737 } }
I20260811 07:08:00.458099 22492 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:00.458228 22492 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cb83eac5da340d7bad789e42b2fca3c, State: Initialized, Role: FOLLOWER
I20260811 07:08:00.458799 22492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb83eac5da340d7bad789e42b2fca3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40737 } }
I20260811 07:08:00.459053 22492 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:00.459237 22492 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:00.459425 22492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:00.461716 22492 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb83eac5da340d7bad789e42b2fca3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40737 } }
I20260811 07:08:00.462281 22492 leader_election.cc:302] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cb83eac5da340d7bad789e42b2fca3c; no voters:
I20260811 07:08:00.463040 22492 leader_election.cc:288] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:00.463155 22503 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:00.464655 22503 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [term 1 LEADER]: Becoming Leader. State: Replica: 2cb83eac5da340d7bad789e42b2fca3c, State: Running, Role: LEADER
I20260811 07:08:00.465384 22503 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb83eac5da340d7bad789e42b2fca3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40737 } }
I20260811 07:08:00.465600 22492 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:00.473731 22495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:00.459126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48399 (local address 127.0.0.1:40737)
0811 07:08:00.459309 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:00.459316 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:00.459882 (+ 566us) server_negotiation.cc:407] Connection header received
0811 07:08:00.460091 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:00.460098 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:00.460175 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:00.460314 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:00.461770 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:00.462688 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:00.464431 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:00.465121 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:00.465283 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:00.467954 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:00.467960 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:00.467964 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:00.468000 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:00.470882 (+ 2882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:00.471537 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:00.471544 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:00.471548 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:00.471739 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:00.472131 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:00.472136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:00.472140 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:00.472423 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:00.472715 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:00.473048 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 07:08:00.473299 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:08:00.476991 22506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cb83eac5da340d7bad789e42b2fca3c. Latest consensus state: current_term: 1 leader_uuid: "2cb83eac5da340d7bad789e42b2fca3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb83eac5da340d7bad789e42b2fca3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40737 } } }
I20260811 07:08:00.477411 22506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:00.476877 22504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cb83eac5da340d7bad789e42b2fca3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cb83eac5da340d7bad789e42b2fca3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40737 } } }
I20260811 07:08:00.477950 22504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c [sys.catalog]: This master's current role is: LEADER
W20260811 07:08:00.485097 22521 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:08:00.485282 22521 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:08:00.485694 22515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:00.488013 22515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:00.495914 22515 catalog_manager.cc:1347] Generated new cluster ID: 7d466b9d6a4e4504b11fd0c97de65149
I20260811 07:08:00.496024 22515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:00.534832 22515 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:00.536231 22515 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:00.546501 22515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2cb83eac5da340d7bad789e42b2fca3c: Generated new TSK 0
I20260811 07:08:00.547636 22515 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:00.560187 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22415
I20260811 07:08:00.561570 22486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:00.658653 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 22415
2026-08-11T07:08:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2291 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:00 dist-test-slave-69rg krb5kdc[22528](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:00 dist-test-slave-69rg krb5kdc[22528](info): set up 2 sockets
Aug 11 07:08:00 dist-test-slave-69rg krb5kdc[22528](info): commencing operation
krb5kdc: starting...
W20260811 07:08:01.904999 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:02 dist-test-slave-69rg krb5kdc[22528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:08:02.265966 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36751
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:02.623618 22545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:02.623934 22545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:02.624100 22545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:02.631976 22545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:02.632108 22545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:02.632251 22545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:02.632375 22545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:02.632439 22545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:02.642716 22545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:02.644110 22545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:02.645426 22545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:02.657769 22552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:02.657856 22551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:02.657810 22554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:02.659416 22545 server_base.cc:1034] running on GCE node
I20260811 07:08:02.660235 22545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:02.661724 22545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:02.662938 22545 hybrid_clock.cc:648] HybridClock initialized: now 1786432082662891 us; error 39 us; skew 500 ppm
I20260811 07:08:02.663278 22545 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:02 dist-test-slave-69rg krb5kdc[22528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432082, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:02.666558 22545 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:08:02.668008 22545 webserver.cc:460] Webserver started at http://127.0.0.1:40435/ using document root <none> and password file <none>
I20260811 07:08:02.668651 22545 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:02.668757 22545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:02.669001 22545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:02.672006 22545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "a7967f7651e84a97ac24e9cb89dd92dd"
format_stamp: "Formatted at 2026-08-11 07:08:02 on dist-test-slave-69rg"
server_key: "3603d52dc6f580c8e1de0e0cf0661bd0"
server_key_iv: "b0e64797aec05ae174d3bc5f07aa9db4"
server_key_version: "encryptionkey@0"
I20260811 07:08:02.672755 22545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "a7967f7651e84a97ac24e9cb89dd92dd"
format_stamp: "Formatted at 2026-08-11 07:08:02 on dist-test-slave-69rg"
server_key: "3603d52dc6f580c8e1de0e0cf0661bd0"
server_key_iv: "b0e64797aec05ae174d3bc5f07aa9db4"
server_key_version: "encryptionkey@0"
I20260811 07:08:02.677910 22545 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 07:08:02.681512 22561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:02.682955 22545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 07:08:02.683136 22545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "a7967f7651e84a97ac24e9cb89dd92dd"
format_stamp: "Formatted at 2026-08-11 07:08:02 on dist-test-slave-69rg"
server_key: "3603d52dc6f580c8e1de0e0cf0661bd0"
server_key_iv: "b0e64797aec05ae174d3bc5f07aa9db4"
server_key_version: "encryptionkey@0"
I20260811 07:08:02.683303 22545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:02.704479 22545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:02.708603 22545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:02.708855 22545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:02.728302 22545 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36751
I20260811 07:08:02.728331 22622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36751 every 8 connection(s)
I20260811 07:08:02.729847 22545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:02.730353 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 22545
I20260811 07:08:02.730566 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:02.731182 31013 external_mini_cluster.cc:1428] Setting key 1c29ff07ecdfaae2cbf42426da4c31fa
I20260811 07:08:02.734333 22623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:02.747804 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:02.733341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41225 (local address 127.0.0.1:36751)
0811 07:08:02.734340 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:02.734358 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:02.734757 (+ 399us) server_negotiation.cc:407] Connection header received
0811 07:08:02.737176 (+ 2419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:02.737203 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:02.737725 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:02.738209 (+ 484us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:02.738730 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:02.740788 (+ 2058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:02.742229 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:02.743277 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:02.743475 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:02.744720 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:02.744730 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:02.744749 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:02.745588 (+ 839us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:02.745703 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:02.745739 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:02.745891 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:02.746134 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 07:08:02.746433 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733,"thread_start_us":460,"threads_started":1}
I20260811 07:08:02.749034 22623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd: Bootstrap starting.
I20260811 07:08:02.751691 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:02.752439 22623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:02.753441 22623 log.cc:824] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:02.756951 22623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd: No bootstrap required, opened a new log
I20260811 07:08:02.763242 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:02.756494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33471 (local address 127.0.0.1:36751)
0811 07:08:02.756773 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:02.756780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:02.757428 (+ 648us) server_negotiation.cc:407] Connection header received
0811 07:08:02.757679 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:02.757683 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:02.757751 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:02.757914 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:02.758468 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:02.759252 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:02.760590 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:02.761086 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:02.761263 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:02.762461 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:02.762466 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:02.762473 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:02.762491 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:02.762528 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:02.762544 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:02.762645 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:02.762817 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:08:02.762916 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 07:08:02.765017 22623 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7967f7651e84a97ac24e9cb89dd92dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36751 } }
I20260811 07:08:02.765442 22623 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:02.765558 22623 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7967f7651e84a97ac24e9cb89dd92dd, State: Initialized, Role: FOLLOWER
I20260811 07:08:02.766218 22623 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7967f7651e84a97ac24e9cb89dd92dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36751 } }
I20260811 07:08:02.766465 22623 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:02.766615 22623 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:02.766806 22623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:02.769384 22623 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7967f7651e84a97ac24e9cb89dd92dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36751 } }
I20260811 07:08:02.769964 22623 leader_election.cc:302] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7967f7651e84a97ac24e9cb89dd92dd; no voters:
I20260811 07:08:02.770591 22623 leader_election.cc:288] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:02.770733 22634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:02.771451 22634 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [term 1 LEADER]: Becoming Leader. State: Replica: a7967f7651e84a97ac24e9cb89dd92dd, State: Running, Role: LEADER
I20260811 07:08:02.772002 22634 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7967f7651e84a97ac24e9cb89dd92dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36751 } }
I20260811 07:08:02.772739 22623 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:02.775688 22636 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7967f7651e84a97ac24e9cb89dd92dd. Latest consensus state: current_term: 1 leader_uuid: "a7967f7651e84a97ac24e9cb89dd92dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7967f7651e84a97ac24e9cb89dd92dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36751 } } }
I20260811 07:08:02.775692 22635 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7967f7651e84a97ac24e9cb89dd92dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7967f7651e84a97ac24e9cb89dd92dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36751 } } }
I20260811 07:08:02.776193 22636 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:02.776193 22635 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:02.777963 22640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:02.783017 22640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:02.792806 22640 catalog_manager.cc:1347] Generated new cluster ID: a948e8210d4e4c3daa62d4e1e9b5744e
I20260811 07:08:02.792935 22640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:02.805622 22640 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:02.807576 22640 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:02.816980 22640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7967f7651e84a97ac24e9cb89dd92dd: Generated new TSK 0
I20260811 07:08:02.818064 22640 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:02.835093 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22545
W20260811 07:08:02.836228 22617 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41225
W20260811 07:08:02.837175 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22545: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:02.837340 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 22545
2026-08-11T07:08:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2179 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:02 dist-test-slave-69rg krb5kdc[22657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:02 dist-test-slave-69rg krb5kdc[22657](info): set up 2 sockets
Aug 11 07:08:02 dist-test-slave-69rg krb5kdc[22657](info): commencing operation
krb5kdc: starting...
W20260811 07:08:04.086944 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.001s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:04 dist-test-slave-69rg krb5kdc[22657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:08:04.433384 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42133
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:04.795207 22672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:04.795650 22672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:04.795846 22672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:04.804010 22672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:04.804212 22672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:04.804333 22672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:04.804454 22672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:04.804538 22672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:04.816038 22672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:04.817940 22672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:04.819715 22672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:04.834411 22683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:04.834649 22677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:04.834481 22681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:04.835368 22672 server_base.cc:1034] running on GCE node
I20260811 07:08:04.836549 22672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:04.838529 22672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:04.839847 22672 hybrid_clock.cc:648] HybridClock initialized: now 1786432084839789 us; error 52 us; skew 500 ppm
I20260811 07:08:04.840309 22672 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:04 dist-test-slave-69rg krb5kdc[22657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432084, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:04.844465 22672 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:08:04.846417 22672 webserver.cc:460] Webserver started at http://127.0.0.1:41133/ using document root <none> and password file <none>
I20260811 07:08:04.847278 22672 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:04.847402 22672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:04.847744 22672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:04.851675 22672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8"
format_stamp: "Formatted at 2026-08-11 07:08:04 on dist-test-slave-69rg"
server_key: "84833eb03e0b1dc85c0a9305e6c9dc57"
server_key_iv: "4ae01f8590d5baa9816029688ed33ecf"
server_key_version: "encryptionkey@0"
I20260811 07:08:04.852639 22672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8"
format_stamp: "Formatted at 2026-08-11 07:08:04 on dist-test-slave-69rg"
server_key: "84833eb03e0b1dc85c0a9305e6c9dc57"
server_key_iv: "4ae01f8590d5baa9816029688ed33ecf"
server_key_version: "encryptionkey@0"
I20260811 07:08:04.859447 22672 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 07:08:04.864063 22692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:04.865911 22672 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:08:04.866202 22672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8"
format_stamp: "Formatted at 2026-08-11 07:08:04 on dist-test-slave-69rg"
server_key: "84833eb03e0b1dc85c0a9305e6c9dc57"
server_key_iv: "4ae01f8590d5baa9816029688ed33ecf"
server_key_version: "encryptionkey@0"
I20260811 07:08:04.866504 22672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:04.874279 22672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:04.879899 22672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:04.880304 22672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:04.902985 22672 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42133
I20260811 07:08:04.903023 22749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42133 every 8 connection(s)
I20260811 07:08:04.904948 22672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:04.907492 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 22672
I20260811 07:08:04.907769 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:04.908450 31013 external_mini_cluster.cc:1428] Setting key aea9149a142137e27620b92fcce3f67d
I20260811 07:08:04.911048 22750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:04.918819 22753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:04.910949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39541 (local address 127.0.0.1:42133)
0811 07:08:04.912085 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:04.912101 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:04.912160 (+ 59us) server_negotiation.cc:407] Connection header received
0811 07:08:04.914308 (+ 2148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:04.914339 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:04.914836 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:04.915307 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:04.916677 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:04.916688 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:04.916706 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:04.916725 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:04.916828 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:04.916860 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:04.917081 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:04.917211 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 07:08:04.917486 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":515,"threads_started":1}
I20260811 07:08:04.923662 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:04.926815 22750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8: Bootstrap starting.
I20260811 07:08:04.931354 22750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:04.933115 22753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:04.929927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53249 (local address 127.0.0.1:42133)
0811 07:08:04.930204 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:04.930211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:04.930573 (+ 362us) server_negotiation.cc:407] Connection header received
0811 07:08:04.930788 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:04.930792 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:04.930856 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:04.930957 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:04.932195 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:04.932199 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:04.932203 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:04.932221 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:04.932276 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:04.932293 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:04.932411 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:04.932605 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 07:08:04.932676 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 07:08:04.933094 22750 log.cc:824] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:04.937047 22750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8: No bootstrap required, opened a new log
I20260811 07:08:04.946441 22750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42133 } }
I20260811 07:08:04.947010 22750 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:04.947149 22750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ec4c3c512f34e45aac9fc6b4f7301d8, State: Initialized, Role: FOLLOWER
I20260811 07:08:04.947839 22750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42133 } }
I20260811 07:08:04.948098 22750 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:04.948274 22750 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:04.948485 22750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:04.951210 22750 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42133 } }
I20260811 07:08:04.951857 22750 leader_election.cc:302] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ec4c3c512f34e45aac9fc6b4f7301d8; no voters:
I20260811 07:08:04.952701 22750 leader_election.cc:288] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:04.952816 22761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:04.953771 22761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9ec4c3c512f34e45aac9fc6b4f7301d8, State: Running, Role: LEADER
I20260811 07:08:04.954444 22761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42133 } }
I20260811 07:08:04.955340 22750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:04.957772 22763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ec4c3c512f34e45aac9fc6b4f7301d8. Latest consensus state: current_term: 1 leader_uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42133 } } }
I20260811 07:08:04.957762 22762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ec4c3c512f34e45aac9fc6b4f7301d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42133 } } }
I20260811 07:08:04.958382 22762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:04.958798 22763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:04.963356 22766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:04.970329 22766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:04.981168 22766 catalog_manager.cc:1347] Generated new cluster ID: 7f4d617ceb694133a74bd5731ee97c08
I20260811 07:08:04.981346 22766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:05.011749 22766 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:05.012483 22766 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:05.023294 22766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ec4c3c512f34e45aac9fc6b4f7301d8: Generated new TSK 0
I20260811 07:08:05.024586 22766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:05.048455 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22672
W20260811 07:08:05.049988 22743 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39541
W20260811 07:08:05.050978 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22672: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:05.051203 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 22672
2026-08-11T07:08:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2221 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:05 dist-test-slave-69rg krb5kdc[22784](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:05 dist-test-slave-69rg krb5kdc[22784](info): set up 2 sockets
Aug 11 07:08:05 dist-test-slave-69rg krb5kdc[22784](info): commencing operation
krb5kdc: starting...
W20260811 07:08:06.333304 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.005s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:06 dist-test-slave-69rg krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432086, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:08:06.694802 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35937
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:07.111851 22800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:07.112288 22800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:07.112399 22800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:07.122987 22800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:07.123171 22800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:07.123224 22800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:07.123294 22800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:07.123344 22800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:07.135349 22800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:07.137120 22800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:07.138836 22800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:07.154635 22808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:07.154619 22806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:07.154659 22805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:07.160085 22800 server_base.cc:1034] running on GCE node
I20260811 07:08:07.161375 22800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:07.163625 22800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:07.164906 22800 hybrid_clock.cc:648] HybridClock initialized: now 1786432087164846 us; error 62 us; skew 500 ppm
I20260811 07:08:07.165403 22800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:07 dist-test-slave-69rg krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432087, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:07.174969 22800 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:08:07.177495 22800 webserver.cc:460] Webserver started at http://127.0.0.1:38151/ using document root <none> and password file <none>
I20260811 07:08:07.178602 22800 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:07.178746 22800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:07.179091 22800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:07.183131 22800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "6038618832bd4460af1b4dd5897352c6"
format_stamp: "Formatted at 2026-08-11 07:08:07 on dist-test-slave-69rg"
server_key: "e7d0596eefdd95da6f83be2d79cb762e"
server_key_iv: "07c7d4f9366a3c5cb2d2d88f4bd4900a"
server_key_version: "encryptionkey@0"
I20260811 07:08:07.184231 22800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "6038618832bd4460af1b4dd5897352c6"
format_stamp: "Formatted at 2026-08-11 07:08:07 on dist-test-slave-69rg"
server_key: "e7d0596eefdd95da6f83be2d79cb762e"
server_key_iv: "07c7d4f9366a3c5cb2d2d88f4bd4900a"
server_key_version: "encryptionkey@0"
I20260811 07:08:07.192016 22800 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260811 07:08:07.197089 22817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:07.199597 22800 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 07:08:07.199852 22800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "6038618832bd4460af1b4dd5897352c6"
format_stamp: "Formatted at 2026-08-11 07:08:07 on dist-test-slave-69rg"
server_key: "e7d0596eefdd95da6f83be2d79cb762e"
server_key_iv: "07c7d4f9366a3c5cb2d2d88f4bd4900a"
server_key_version: "encryptionkey@0"
I20260811 07:08:07.200120 22800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:07.234808 22800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:07.240850 22800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:07.241206 22800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:07.266137 22800 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35937
I20260811 07:08:07.266515 22875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35937 every 8 connection(s)
I20260811 07:08:07.268204 22800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:07.274196 22876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:07.274566 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 22800
I20260811 07:08:07.274808 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:07.275377 31013 external_mini_cluster.cc:1428] Setting key cdfa7344c5f7bff045a9940753e15c04
I20260811 07:08:07.291338 22876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6: Bootstrap starting.
Aug 11 07:08:07 dist-test-slave-69rg krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432086, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:08:07.296361 22876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:07.298281 22876 log.cc:824] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:07.302973 22876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6: No bootstrap required, opened a new log
I20260811 07:08:07.307054 22880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:07.277686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:48051 (local address 127.0.0.1:35937)
0811 07:08:07.278809 (+ 1123us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:07.278824 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:07.278875 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:08:07.281780 (+ 2905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:07.281815 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:07.282527 (+ 712us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:07.282987 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:07.285164 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:07.286980 (+ 1816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:07.289012 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:07.289943 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:07.290105 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:07.296159 (+ 6054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:07.296177 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:07.296212 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:07.296290 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:07.301004 (+ 4714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:07.302324 (+ 1320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:07.302334 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:07.302345 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:07.302626 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:07.303225 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:07.303236 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:07.303239 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:07.303953 (+ 714us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:07.304350 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:07.304957 (+ 607us) server_negotiation.cc:299] Negotiation successful
0811 07:08:07.305369 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":869,"thread_start_us":518,"threads_started":1}
I20260811 07:08:07.312147 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:07.314073 22876 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6038618832bd4460af1b4dd5897352c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35937 } }
I20260811 07:08:07.314613 22876 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:07.314764 22876 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6038618832bd4460af1b4dd5897352c6, State: Initialized, Role: FOLLOWER
I20260811 07:08:07.315577 22876 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6038618832bd4460af1b4dd5897352c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35937 } }
I20260811 07:08:07.315984 22876 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:07.316196 22876 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:07.316442 22876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:07.319712 22876 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6038618832bd4460af1b4dd5897352c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35937 } }
I20260811 07:08:07.320626 22876 leader_election.cc:302] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6038618832bd4460af1b4dd5897352c6; no voters:
I20260811 07:08:07.321616 22876 leader_election.cc:288] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:07.321758 22887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:07.324198 22887 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6038618832bd4460af1b4dd5897352c6, State: Running, Role: LEADER
I20260811 07:08:07.324980 22876 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:07.325055 22887 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6038618832bd4460af1b4dd5897352c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35937 } }
I20260811 07:08:07.331373 22888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6038618832bd4460af1b4dd5897352c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6038618832bd4460af1b4dd5897352c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35937 } } }
I20260811 07:08:07.332047 22888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:07.332653 22889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6038618832bd4460af1b4dd5897352c6. Latest consensus state: current_term: 1 leader_uuid: "6038618832bd4460af1b4dd5897352c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6038618832bd4460af1b4dd5897352c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35937 } } }
I20260811 07:08:07.333056 22889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:07.340509 22896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:07.347738 22896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:07.349148 22880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:07.318170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:43369 (local address 127.0.0.1:35937)
0811 07:08:07.318439 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:07.318447 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:07.320722 (+ 2275us) server_negotiation.cc:407] Connection header received
0811 07:08:07.321019 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:07.321025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:07.321117 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:07.321222 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:07.323940 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:07.325454 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:07.327901 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:07.329145 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:07.329338 (+ 193us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:07.335412 (+ 6074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:07.335427 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:07.335436 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:07.335520 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:07.341995 (+ 6475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:07.343850 (+ 1855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:07.343858 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:07.343865 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:07.344114 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:07.345258 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:07.345268 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:07.345274 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:07.345970 (+ 696us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:07.346370 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:07.348216 (+ 1846us) server_negotiation.cc:299] Negotiation successful
0811 07:08:07.348549 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:08:07.361940 22896 catalog_manager.cc:1347] Generated new cluster ID: 6b1fd617710c4abbb5b017f46ffcd150
I20260811 07:08:07.362116 22896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:07.410264 22896 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:07.411990 22896 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:07.430269 22896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6038618832bd4460af1b4dd5897352c6: Generated new TSK 0
I20260811 07:08:07.431826 22896 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:07.452922 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22800
I20260811 07:08:07.455381 22871 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:07.567667 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 22800
W20260811 07:08:07.596833 22782 connection.cc:535] client connection to 127.0.0.1:35937 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35937): Connection reset by peer (error 104)
2026-08-11T07:08:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2516 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:07 dist-test-slave-69rg krb5kdc[22914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:07 dist-test-slave-69rg krb5kdc[22914](info): set up 2 sockets
Aug 11 07:08:07 dist-test-slave-69rg krb5kdc[22914](info): commencing operation
krb5kdc: starting...
W20260811 07:08:08.934360 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.003s sys 0.070s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:09 dist-test-slave-69rg krb5kdc[22914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:08:09.306113 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36731
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:09.691884 22927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:09.692224 22927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:09.692380 22927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:09.700714 22927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:09.700853 22927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:09.700981 22927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:09.701095 22927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:09.701171 22927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:09.711923 22927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:09.713340 22927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:09.714854 22927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:09.727713 22932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:09.727620 22935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:09.727638 22933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:09.728919 22927 server_base.cc:1034] running on GCE node
I20260811 07:08:09.729763 22927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:09.731289 22927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:09.732527 22927 hybrid_clock.cc:648] HybridClock initialized: now 1786432089732475 us; error 36 us; skew 500 ppm
I20260811 07:08:09.732882 22927 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:09 dist-test-slave-69rg krb5kdc[22914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432089, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:09.736317 22927 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:08:09.738111 22927 webserver.cc:460] Webserver started at http://127.0.0.1:45037/ using document root <none> and password file <none>
I20260811 07:08:09.738844 22927 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:09.738993 22927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:09.739337 22927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:09.742549 22927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "2865a88d301642f89ead70eace2db7a1"
format_stamp: "Formatted at 2026-08-11 07:08:09 on dist-test-slave-69rg"
server_key: "16dfd2b97afab8e1a98a3a098d8ef354"
server_key_iv: "bf59bdf239904006d8802c50cb5d8074"
server_key_version: "encryptionkey@0"
I20260811 07:08:09.743402 22927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "2865a88d301642f89ead70eace2db7a1"
format_stamp: "Formatted at 2026-08-11 07:08:09 on dist-test-slave-69rg"
server_key: "16dfd2b97afab8e1a98a3a098d8ef354"
server_key_iv: "bf59bdf239904006d8802c50cb5d8074"
server_key_version: "encryptionkey@0"
I20260811 07:08:09.748893 22927 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 07:08:09.752799 22944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:09.754345 22927 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:08:09.754551 22927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "2865a88d301642f89ead70eace2db7a1"
format_stamp: "Formatted at 2026-08-11 07:08:09 on dist-test-slave-69rg"
server_key: "16dfd2b97afab8e1a98a3a098d8ef354"
server_key_iv: "bf59bdf239904006d8802c50cb5d8074"
server_key_version: "encryptionkey@0"
I20260811 07:08:09.754760 22927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:09.771569 22927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:09.776043 22927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:09.776371 22927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:09.796185 22927 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36731
I20260811 07:08:09.796221 23003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36731 every 8 connection(s)
I20260811 07:08:09.797590 22927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:09.801410 23004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:09.803750 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 22927
I20260811 07:08:09.803956 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:09.804448 31013 external_mini_cluster.cc:1428] Setting key 3cf5f89350d092cb83a01023a7a4d97e
I20260811 07:08:09.813709 23004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1: Bootstrap starting.
I20260811 07:08:09.817539 23004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:09.818622 23007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:09.806465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:33739 (local address 127.0.0.1:36731)
0811 07:08:09.807353 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:09.807366 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:09.807409 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:08:09.809087 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:09.809110 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:09.809513 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:09.809897 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:09.810473 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:09.811853 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:09.813793 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:09.814556 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:09.814697 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:09.816080 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:09.816087 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:09.816101 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:09.816677 (+ 576us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:09.816756 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:09.816780 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:09.816908 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:09.817327 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 07:08:09.817508 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":415,"threads_started":1}
I20260811 07:08:09.818797 23004 log.cc:824] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:09.822299 23004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1: No bootstrap required, opened a new log
I20260811 07:08:09.822834 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:09.830703 23004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2865a88d301642f89ead70eace2db7a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36731 } }
I20260811 07:08:09.831073 23004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:09.831194 23004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2865a88d301642f89ead70eace2db7a1, State: Initialized, Role: FOLLOWER
I20260811 07:08:09.831881 23004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2865a88d301642f89ead70eace2db7a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36731 } }
I20260811 07:08:09.832154 23004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:09.832307 23004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:09.832496 23004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:09.834007 23007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:09.827522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:52063 (local address 127.0.0.1:36731)
0811 07:08:09.827715 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:09.827731 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:09.828084 (+ 353us) server_negotiation.cc:407] Connection header received
0811 07:08:09.828311 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:09.828316 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:09.828382 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:09.828504 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:09.829024 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:09.829885 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:09.831262 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:09.831757 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:09.831898 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:09.833143 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:09.833153 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:09.833157 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:09.833176 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:09.833233 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:09.833256 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:09.833395 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:09.833605 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 07:08:09.833659 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:08:09.835633 23004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2865a88d301642f89ead70eace2db7a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36731 } }
I20260811 07:08:09.836193 23004 leader_election.cc:302] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2865a88d301642f89ead70eace2db7a1; no voters:
I20260811 07:08:09.836755 23004 leader_election.cc:288] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:09.836898 23014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:09.837651 23014 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [term 1 LEADER]: Becoming Leader. State: Replica: 2865a88d301642f89ead70eace2db7a1, State: Running, Role: LEADER
I20260811 07:08:09.838356 23014 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2865a88d301642f89ead70eace2db7a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36731 } }
I20260811 07:08:09.839251 23004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:09.841348 23015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2865a88d301642f89ead70eace2db7a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2865a88d301642f89ead70eace2db7a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36731 } } }
I20260811 07:08:09.841322 23016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2865a88d301642f89ead70eace2db7a1. Latest consensus state: current_term: 1 leader_uuid: "2865a88d301642f89ead70eace2db7a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2865a88d301642f89ead70eace2db7a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36731 } } }
I20260811 07:08:09.841938 23016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:09.842036 23015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:09.843652 23020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:09.849151 23020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:09.859622 23020 catalog_manager.cc:1347] Generated new cluster ID: d3e8cd31134c4c2d9a8b50d747b5e0a5
I20260811 07:08:09.859768 23020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:09.877077 23020 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:09.878566 23020 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:09.887176 23020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2865a88d301642f89ead70eace2db7a1: Generated new TSK 0
I20260811 07:08:09.888223 23020 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:09.899681 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22927
W20260811 07:08:09.900964 22998 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.162:33739
W20260811 07:08:09.901832 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 22927: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:09.901997 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 22927
W20260811 07:08:09.924816 22912 connection.cc:535] client connection to 127.0.0.1:36731 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36731): Connection reset by peer (error 104)
2026-08-11T07:08:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2327 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:10 dist-test-slave-69rg krb5kdc[23037](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:10 dist-test-slave-69rg krb5kdc[23037](info): set up 2 sockets
Aug 11 07:08:10 dist-test-slave-69rg krb5kdc[23037](info): commencing operation
krb5kdc: starting...
W20260811 07:08:11.149778 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.005s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:11 dist-test-slave-69rg krb5kdc[23037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:08:11.503290 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:11.876543 23052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:11.876932 23052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:11.877125 23052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:11.885313 23052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:11.885528 23052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:11.885649 23052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:11.885768 23052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:11.885877 23052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:11.896602 23052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:11.898166 23052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:11.899616 23052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:11.911938 23058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:11.912063 23059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:11.912045 23061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:11.913079 23052 server_base.cc:1034] running on GCE node
I20260811 07:08:11.914021 23052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:11.915493 23052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:11.916707 23052 hybrid_clock.cc:648] HybridClock initialized: now 1786432091916660 us; error 39 us; skew 500 ppm
I20260811 07:08:11.917094 23052 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:11 dist-test-slave-69rg krb5kdc[23037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432091, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:11.920609 23052 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:08:11.922358 23052 webserver.cc:460] Webserver started at http://127.0.0.1:35383/ using document root <none> and password file <none>
I20260811 07:08:11.923079 23052 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:11.923249 23052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:11.923588 23052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:11.926774 23052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "d4c0e85590444d5db720dc8def13135a"
format_stamp: "Formatted at 2026-08-11 07:08:11 on dist-test-slave-69rg"
server_key: "0afd00538d24af6db8b7f855bba712af"
server_key_iv: "42e026b64d6291fbe6ed320ec996b3b4"
server_key_version: "encryptionkey@0"
I20260811 07:08:11.927623 23052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "d4c0e85590444d5db720dc8def13135a"
format_stamp: "Formatted at 2026-08-11 07:08:11 on dist-test-slave-69rg"
server_key: "0afd00538d24af6db8b7f855bba712af"
server_key_iv: "42e026b64d6291fbe6ed320ec996b3b4"
server_key_version: "encryptionkey@0"
I20260811 07:08:11.933341 23052 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 07:08:11.937155 23068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:11.938777 23052 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:08:11.939003 23052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "d4c0e85590444d5db720dc8def13135a"
format_stamp: "Formatted at 2026-08-11 07:08:11 on dist-test-slave-69rg"
server_key: "0afd00538d24af6db8b7f855bba712af"
server_key_iv: "42e026b64d6291fbe6ed320ec996b3b4"
server_key_version: "encryptionkey@0"
I20260811 07:08:11.939247 23052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:11.945549 23052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:11.949977 23052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:11.950299 23052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:11.970819 23052 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37981
I20260811 07:08:11.970880 23130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37981 every 8 connection(s)
I20260811 07:08:11.972396 23052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:11.976894 23131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:11.978659 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 23052
I20260811 07:08:11.978883 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:11.979449 31013 external_mini_cluster.cc:1428] Setting key 20d72a79a70e8547929dd27f918d3885
I20260811 07:08:11.987608 23137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:11.981502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:50907 (local address 127.0.0.1:37981)
0811 07:08:11.982425 (+ 923us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:11.982438 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:11.982481 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:08:11.984128 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:11.984150 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:11.984505 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:11.984915 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:11.985981 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:11.985988 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:11.986001 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:11.986015 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:11.986074 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:11.986097 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:11.986346 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:11.986480 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 07:08:11.986678 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":430,"threads_started":1}
I20260811 07:08:11.991886 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:11.992192 23131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a: Bootstrap starting.
I20260811 07:08:11.996316 23131 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:11.997953 23131 log.cc:824] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:12.000000 23137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:11.997289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:39381 (local address 127.0.0.1:37981)
0811 07:08:11.997514 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:11.997520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:11.997798 (+ 278us) server_negotiation.cc:407] Connection header received
0811 07:08:11.998048 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:11.998088 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:11.998166 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:11.998287 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:11.999281 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:11.999287 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:11.999292 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:11.999311 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:11.999360 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:11.999376 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:11.999505 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:11.999635 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 07:08:11.999702 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:08:12.002363 23131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a: No bootstrap required, opened a new log
I20260811 07:08:12.011267 23131 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c0e85590444d5db720dc8def13135a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37981 } }
I20260811 07:08:12.011873 23131 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:12.012044 23131 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4c0e85590444d5db720dc8def13135a, State: Initialized, Role: FOLLOWER
I20260811 07:08:12.012864 23131 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c0e85590444d5db720dc8def13135a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37981 } }
I20260811 07:08:12.013159 23131 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:12.013345 23131 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:12.013561 23131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:12.016360 23131 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c0e85590444d5db720dc8def13135a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37981 } }
I20260811 07:08:12.016911 23131 leader_election.cc:302] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4c0e85590444d5db720dc8def13135a; no voters:
I20260811 07:08:12.017529 23131 leader_election.cc:288] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:12.017798 23146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:12.018708 23146 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [term 1 LEADER]: Becoming Leader. State: Replica: d4c0e85590444d5db720dc8def13135a, State: Running, Role: LEADER
I20260811 07:08:12.019387 23146 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c0e85590444d5db720dc8def13135a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37981 } }
I20260811 07:08:12.020133 23131 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:12.022778 23148 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4c0e85590444d5db720dc8def13135a. Latest consensus state: current_term: 1 leader_uuid: "d4c0e85590444d5db720dc8def13135a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c0e85590444d5db720dc8def13135a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37981 } } }
I20260811 07:08:12.022993 23147 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4c0e85590444d5db720dc8def13135a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c0e85590444d5db720dc8def13135a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37981 } } }
I20260811 07:08:12.023511 23148 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:12.023522 23147 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:12.025440 23155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:12.033569 23155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:12.046067 23155 catalog_manager.cc:1347] Generated new cluster ID: 4e477bb407a94522bfe6a04188fdc02e
I20260811 07:08:12.046218 23155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:12.063246 23155 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:12.064039 23155 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:12.073659 23155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4c0e85590444d5db720dc8def13135a: Generated new TSK 0
I20260811 07:08:12.074637 23155 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:12.087155 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23052
W20260811 07:08:12.088652 23123 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.162:50907
W20260811 07:08:12.089491 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23052: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:12.089679 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 23052
2026-08-11T07:08:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2191 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:12 dist-test-slave-69rg krb5kdc[23168](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:12 dist-test-slave-69rg krb5kdc[23168](info): set up 2 sockets
Aug 11 07:08:12 dist-test-slave-69rg krb5kdc[23168](info): commencing operation
krb5kdc: starting...
W20260811 07:08:13.349920 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:13 dist-test-slave-69rg krb5kdc[23168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:08:13.702878 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34149
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:14.067282 23183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:14.067590 23183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:14.067770 23183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:14.075289 23183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:14.075412 23183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:14.075500 23183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:14.075588 23183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:14.075667 23183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:14.086160 23183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34149
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:14.087623 23183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:14.088999 23183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:14.101583 23190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:14.101707 23194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:14.101730 23191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:14.102454 23183 server_base.cc:1034] running on GCE node
I20260811 07:08:14.103377 23183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:14.104938 23183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:14.106194 23183 hybrid_clock.cc:648] HybridClock initialized: now 1786432094106161 us; error 49 us; skew 500 ppm
I20260811 07:08:14.106631 23183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:14 dist-test-slave-69rg krb5kdc[23168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432094, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:14.110054 23183 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:08:14.111692 23183 webserver.cc:460] Webserver started at http://127.0.0.1:44977/ using document root <none> and password file <none>
I20260811 07:08:14.112468 23183 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:14.112636 23183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:14.112982 23183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:14.116477 23183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "7cbe9b54163441ad93cc49b74438d74e"
format_stamp: "Formatted at 2026-08-11 07:08:14 on dist-test-slave-69rg"
server_key: "a09a278ee53130179cfd619de7b0f65f"
server_key_iv: "914eb9a62ba1bea8b17b7c316d34800c"
server_key_version: "encryptionkey@0"
I20260811 07:08:14.117323 23183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "7cbe9b54163441ad93cc49b74438d74e"
format_stamp: "Formatted at 2026-08-11 07:08:14 on dist-test-slave-69rg"
server_key: "a09a278ee53130179cfd619de7b0f65f"
server_key_iv: "914eb9a62ba1bea8b17b7c316d34800c"
server_key_version: "encryptionkey@0"
I20260811 07:08:14.122941 23183 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:08:14.126749 23201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:14.128115 23183 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:08:14.128327 23183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "7cbe9b54163441ad93cc49b74438d74e"
format_stamp: "Formatted at 2026-08-11 07:08:14 on dist-test-slave-69rg"
server_key: "a09a278ee53130179cfd619de7b0f65f"
server_key_iv: "914eb9a62ba1bea8b17b7c316d34800c"
server_key_version: "encryptionkey@0"
I20260811 07:08:14.128553 23183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:14.152653 23183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:14.158030 23183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:14.158393 23183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:14.179230 23183 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34149
I20260811 07:08:14.179243 23255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34149 every 8 connection(s)
I20260811 07:08:14.180842 23183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:14.184947 23256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:14.188184 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 23183
I20260811 07:08:14.188405 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:14.188912 31013 external_mini_cluster.cc:1428] Setting key 8ab00da4cf1b1a3db6d74bb7cd9adc75
I20260811 07:08:14.198709 23256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e: Bootstrap starting.
I20260811 07:08:14.202399 23256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:14.203454 23256 log.cc:824] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:08:14 dist-test-slave-69rg krb5kdc[23168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:08:14.207069 23256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e: No bootstrap required, opened a new log
I20260811 07:08:14.217949 23259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:14.191118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:52139 (local address 127.0.0.1:34149)
0811 07:08:14.191908 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:14.191925 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:14.191979 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:08:14.194385 (+ 2406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:14.194419 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:14.195000 (+ 581us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:14.195485 (+ 485us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:14.197057 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:14.199109 (+ 2052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:14.200560 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:14.201600 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:14.201789 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:14.206887 (+ 5098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:14.206899 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:14.206919 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:14.206968 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:14.211399 (+ 4431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:14.212864 (+ 1465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:14.212880 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:14.212889 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:14.213144 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:14.213730 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:14.213740 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:14.213744 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:14.214621 (+ 877us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:14.214990 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:14.215951 (+ 961us) server_negotiation.cc:299] Negotiation successful
0811 07:08:14.216383 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":326,"threads_started":1}
I20260811 07:08:14.218515 23256 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cbe9b54163441ad93cc49b74438d74e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34149 } }
I20260811 07:08:14.219023 23256 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:14.219134 23256 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cbe9b54163441ad93cc49b74438d74e, State: Initialized, Role: FOLLOWER
I20260811 07:08:14.219831 23256 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cbe9b54163441ad93cc49b74438d74e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34149 } }
I20260811 07:08:14.220104 23256 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:14.220269 23256 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:14.220470 23256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:14.222783 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:14.223383 23256 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cbe9b54163441ad93cc49b74438d74e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34149 } }
I20260811 07:08:14.223912 23256 leader_election.cc:302] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cbe9b54163441ad93cc49b74438d74e; no voters:
I20260811 07:08:14.224538 23256 leader_election.cc:288] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:14.224706 23262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:14.227039 23256 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:14.231909 23262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [term 1 LEADER]: Becoming Leader. State: Replica: 7cbe9b54163441ad93cc49b74438d74e, State: Running, Role: LEADER
I20260811 07:08:14.232887 23262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cbe9b54163441ad93cc49b74438d74e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34149 } }
I20260811 07:08:14.238683 23263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cbe9b54163441ad93cc49b74438d74e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cbe9b54163441ad93cc49b74438d74e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34149 } } }
I20260811 07:08:14.239104 23263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:14.239544 23264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cbe9b54163441ad93cc49b74438d74e. Latest consensus state: current_term: 1 leader_uuid: "7cbe9b54163441ad93cc49b74438d74e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cbe9b54163441ad93cc49b74438d74e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34149 } } }
I20260811 07:08:14.239892 23264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:14.240078 23285 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:14.257109 23285 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:14.260025 23259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:14.234040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:35007 (local address 127.0.0.1:34149)
0811 07:08:14.234222 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:14.234229 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:14.236746 (+ 2517us) server_negotiation.cc:407] Connection header received
0811 07:08:14.236982 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:14.236993 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:14.237098 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:14.237232 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:14.239388 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:14.240739 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:14.243556 (+ 2817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:14.244318 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:14.244423 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:14.248550 (+ 4127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:14.248563 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:14.248569 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:14.248641 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:14.252542 (+ 3901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:14.253624 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:14.253630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:14.253634 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:14.253780 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:14.257877 (+ 4097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:14.257882 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:14.257885 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:14.258348 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:14.258638 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:14.259405 (+ 767us) server_negotiation.cc:299] Negotiation successful
0811 07:08:14.259630 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:08:14.271901 23285 catalog_manager.cc:1347] Generated new cluster ID: b6522c9fa62c415ab737408842a1d9fa
I20260811 07:08:14.272035 23285 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:14.289634 23285 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:14.291016 23285 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:14.304211 23285 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cbe9b54163441ad93cc49b74438d74e: Generated new TSK 0
I20260811 07:08:14.305505 23285 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:14.322829 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23183
I20260811 07:08:14.324041 23251 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:14.420183 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 23183
W20260811 07:08:14.442342 23166 connection.cc:535] client connection to 127.0.0.1:34149 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34149): Connection reset by peer (error 104)
2026-08-11T07:08:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2331 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:14 dist-test-slave-69rg krb5kdc[23294](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:14 dist-test-slave-69rg krb5kdc[23294](info): set up 2 sockets
Aug 11 07:08:14 dist-test-slave-69rg krb5kdc[23294](info): commencing operation
krb5kdc: starting...
W20260811 07:08:15.650457 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.003s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:15 dist-test-slave-69rg krb5kdc[23294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:08:16.004614 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44897
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:16.417618 23313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:16.418042 23313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:16.418253 23313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:16.426115 23313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:16.426311 23313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:16.426443 23313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:16.426563 23313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:16.426661 23313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:16.436915 23313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44897
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:16.438436 23313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:16.439853 23313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:16.451956 23318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:16.451922 23319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:16.451890 23321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:16.452749 23313 server_base.cc:1034] running on GCE node
I20260811 07:08:16.453500 23313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:16.454947 23313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:16.456172 23313 hybrid_clock.cc:648] HybridClock initialized: now 1786432096456113 us; error 57 us; skew 500 ppm
I20260811 07:08:16.456532 23313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:16 dist-test-slave-69rg krb5kdc[23294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432096, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:16.459892 23313 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:08:16.461369 23313 webserver.cc:460] Webserver started at http://127.0.0.1:35895/ using document root <none> and password file <none>
I20260811 07:08:16.462146 23313 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:16.462252 23313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:16.462513 23313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:16.465706 23313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "ab89b48f35a349558e3ad10d11c1bdae"
format_stamp: "Formatted at 2026-08-11 07:08:16 on dist-test-slave-69rg"
server_key: "5ea2ee388ebbeeea0ecfbe07efbf5cf1"
server_key_iv: "370fd603884cca13e1a3c6963e96160f"
server_key_version: "encryptionkey@0"
I20260811 07:08:16.466518 23313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "ab89b48f35a349558e3ad10d11c1bdae"
format_stamp: "Formatted at 2026-08-11 07:08:16 on dist-test-slave-69rg"
server_key: "5ea2ee388ebbeeea0ecfbe07efbf5cf1"
server_key_iv: "370fd603884cca13e1a3c6963e96160f"
server_key_version: "encryptionkey@0"
I20260811 07:08:16.471798 23313 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:08:16.475333 23329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:16.476742 23313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:08:16.476922 23313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "ab89b48f35a349558e3ad10d11c1bdae"
format_stamp: "Formatted at 2026-08-11 07:08:16 on dist-test-slave-69rg"
server_key: "5ea2ee388ebbeeea0ecfbe07efbf5cf1"
server_key_iv: "370fd603884cca13e1a3c6963e96160f"
server_key_version: "encryptionkey@0"
I20260811 07:08:16.477097 23313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:16.504645 23313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:16.508873 23313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:16.509128 23313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:16.529868 23313 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44897
I20260811 07:08:16.529920 23385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44897 every 8 connection(s)
I20260811 07:08:16.531365 23313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:16.535282 23386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:16.536880 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 23313
I20260811 07:08:16.537068 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:16.537652 31013 external_mini_cluster.cc:1428] Setting key 7488c412a491c4c024e5942dc59576db
I20260811 07:08:16.550170 23386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae: Bootstrap starting.
I20260811 07:08:16.551959 23390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:16.539665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:47839 (local address 127.0.0.1:44897)
0811 07:08:16.540526 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:16.540538 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:16.540587 (+ 49us) server_negotiation.cc:407] Connection header received
0811 07:08:16.542354 (+ 1767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:16.542381 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:16.542946 (+ 565us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:16.543348 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:16.543953 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:16.545286 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:16.547186 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:16.547943 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:16.548090 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:16.549484 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:16.549492 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:16.549506 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:16.550140 (+ 634us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:16.550231 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:16.550285 (+ 54us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:16.550489 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:16.550782 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 07:08:16.550964 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":402,"threads_started":1}
I20260811 07:08:16.553550 23386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:16.554805 23386 log.cc:824] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:16.556237 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:16.557963 23386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae: No bootstrap required, opened a new log
I20260811 07:08:16.567682 23386 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab89b48f35a349558e3ad10d11c1bdae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44897 } }
I20260811 07:08:16.568145 23386 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:16.568290 23386 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab89b48f35a349558e3ad10d11c1bdae, State: Initialized, Role: FOLLOWER
I20260811 07:08:16.568723 23390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:16.561005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:46899 (local address 127.0.0.1:44897)
0811 07:08:16.561195 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:16.561202 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:16.561701 (+ 499us) server_negotiation.cc:407] Connection header received
0811 07:08:16.561947 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:16.561951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:16.562017 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:16.562101 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:16.562812 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:16.563594 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:16.565539 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:16.566273 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:16.566404 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:16.567805 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:16.567810 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:16.567814 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:16.567833 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:16.567887 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:16.567903 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:16.568039 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:16.568329 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 07:08:16.568394 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:08:16.569016 23386 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab89b48f35a349558e3ad10d11c1bdae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44897 } }
I20260811 07:08:16.569286 23386 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:16.569455 23386 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:16.569675 23386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:16.572114 23386 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab89b48f35a349558e3ad10d11c1bdae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44897 } }
I20260811 07:08:16.572594 23386 leader_election.cc:302] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab89b48f35a349558e3ad10d11c1bdae; no voters:
I20260811 07:08:16.573167 23386 leader_election.cc:288] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:16.573325 23398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:16.574240 23398 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [term 1 LEADER]: Becoming Leader. State: Replica: ab89b48f35a349558e3ad10d11c1bdae, State: Running, Role: LEADER
I20260811 07:08:16.574828 23398 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab89b48f35a349558e3ad10d11c1bdae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44897 } }
I20260811 07:08:16.575465 23386 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:16.583528 23399 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab89b48f35a349558e3ad10d11c1bdae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab89b48f35a349558e3ad10d11c1bdae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44897 } } }
I20260811 07:08:16.583712 23400 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab89b48f35a349558e3ad10d11c1bdae. Latest consensus state: current_term: 1 leader_uuid: "ab89b48f35a349558e3ad10d11c1bdae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab89b48f35a349558e3ad10d11c1bdae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44897 } } }
I20260811 07:08:16.583997 23399 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:16.584029 23400 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:16.590456 23415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:16.595214 23415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:16.604351 23415 catalog_manager.cc:1347] Generated new cluster ID: 7ddefdfce1cd47e085b0b4019316dc13
I20260811 07:08:16.604496 23415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:16.616686 23415 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:16.618840 23415 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:16.635394 23415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab89b48f35a349558e3ad10d11c1bdae: Generated new TSK 0
I20260811 07:08:16.636556 23415 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:16.648136 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23313
W20260811 07:08:16.649593 23381 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.162:47839
W20260811 07:08:16.650424 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23313: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:16.650586 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 23313
W20260811 07:08:16.674502 23292 connection.cc:535] client connection to 127.0.0.1:44897 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44897): Connection reset by peer (error 104)
2026-08-11T07:08:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2227 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:16 dist-test-slave-69rg krb5kdc[23423](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:16 dist-test-slave-69rg krb5kdc[23423](info): set up 2 sockets
Aug 11 07:08:16 dist-test-slave-69rg krb5kdc[23423](info): commencing operation
krb5kdc: starting...
W20260811 07:08:17.895175 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:18 dist-test-slave-69rg krb5kdc[23423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:08:18.294476 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43985
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:18.657970 23437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:18.658407 23437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:18.658573 23437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:18.665872 23437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:18.666052 23437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:18.666172 23437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:18.666294 23437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:18.666371 23437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:18.677753 23437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43985
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:18.679261 23437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:18.680631 23437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:18.692926 23447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:18.693013 23445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:18.693037 23444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:18.694228 23437 server_base.cc:1034] running on GCE node
I20260811 07:08:18.695096 23437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:18.696662 23437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:18.697944 23437 hybrid_clock.cc:648] HybridClock initialized: now 1786432098697896 us; error 42 us; skew 500 ppm
I20260811 07:08:18.698343 23437 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:18 dist-test-slave-69rg krb5kdc[23423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432098, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:18.706038 23437 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:08:18.707741 23437 webserver.cc:460] Webserver started at http://127.0.0.1:46323/ using document root <none> and password file <none>
I20260811 07:08:18.708483 23437 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:18.708637 23437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:18.708964 23437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:18.712239 23437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "d38e143d0102447c9e61f3fd4710c56f"
format_stamp: "Formatted at 2026-08-11 07:08:18 on dist-test-slave-69rg"
server_key: "d805d241b1c9544cd06132d569c2839c"
server_key_iv: "850cbffbd0a0f02790a3c4a9fc0f74fc"
server_key_version: "encryptionkey@0"
I20260811 07:08:18.713059 23437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "d38e143d0102447c9e61f3fd4710c56f"
format_stamp: "Formatted at 2026-08-11 07:08:18 on dist-test-slave-69rg"
server_key: "d805d241b1c9544cd06132d569c2839c"
server_key_iv: "850cbffbd0a0f02790a3c4a9fc0f74fc"
server_key_version: "encryptionkey@0"
I20260811 07:08:18.718969 23437 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:08:18.722534 23454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:18.723861 23437 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:08:18.724042 23437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "d38e143d0102447c9e61f3fd4710c56f"
format_stamp: "Formatted at 2026-08-11 07:08:18 on dist-test-slave-69rg"
server_key: "d805d241b1c9544cd06132d569c2839c"
server_key_iv: "850cbffbd0a0f02790a3c4a9fc0f74fc"
server_key_version: "encryptionkey@0"
I20260811 07:08:18.724244 23437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:18.730221 23437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:18.734297 23437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:18.734583 23437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:18.753893 23437 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43985
I20260811 07:08:18.753980 23515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43985 every 8 connection(s)
I20260811 07:08:18.755298 23437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:18.759085 23516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:18.759200 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 23437
I20260811 07:08:18.759425 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:18.759873 31013 external_mini_cluster.cc:1428] Setting key f22ff86b9be37e66fa4b18ff43e8a9b6
I20260811 07:08:18.768797 23519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:18.761724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:52483 (local address 127.0.0.1:43985)
0811 07:08:18.762699 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:18.762715 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:18.762779 (+ 64us) server_negotiation.cc:407] Connection header received
0811 07:08:18.764773 (+ 1994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:18.764811 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:18.765272 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:18.765798 (+ 526us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:18.766854 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:18.766865 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:18.766895 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:18.766914 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:18.766984 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:18.767010 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:18.767250 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:18.767395 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 07:08:18.767599 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":392,"threads_started":1}
I20260811 07:08:18.773129 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:18.775055 23516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f: Bootstrap starting.
I20260811 07:08:18.778600 23516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:18.779889 23516 log.cc:824] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:18.780970 23519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:18.778016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:45545 (local address 127.0.0.1:43985)
0811 07:08:18.778283 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:18.778293 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:18.778873 (+ 580us) server_negotiation.cc:407] Connection header received
0811 07:08:18.779024 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:18.779034 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:18.779108 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:18.779235 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:18.780230 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:18.780235 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:18.780239 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:18.780259 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:18.780317 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:18.780344 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:18.780495 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:18.780599 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 07:08:18.780666 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:08:18.783087 23516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f: No bootstrap required, opened a new log
I20260811 07:08:18.790661 23516 raft_consensus.cc:348] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d38e143d0102447c9e61f3fd4710c56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43985 } }
I20260811 07:08:18.791040 23516 raft_consensus.cc:374] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:18.791142 23516 raft_consensus.cc:729] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d38e143d0102447c9e61f3fd4710c56f, State: Initialized, Role: FOLLOWER
I20260811 07:08:18.791682 23516 consensus_queue.cc:260] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d38e143d0102447c9e61f3fd4710c56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43985 } }
I20260811 07:08:18.792202 23516 raft_consensus.cc:388] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:18.792366 23516 raft_consensus.cc:482] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:18.792536 23516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:18.794821 23516 raft_consensus.cc:504] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d38e143d0102447c9e61f3fd4710c56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43985 } }
I20260811 07:08:18.795433 23516 leader_election.cc:302] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d38e143d0102447c9e61f3fd4710c56f; no voters:
I20260811 07:08:18.796132 23516 leader_election.cc:288] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:18.796248 23528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:18.797003 23528 raft_consensus.cc:686] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [term 1 LEADER]: Becoming Leader. State: Replica: d38e143d0102447c9e61f3fd4710c56f, State: Running, Role: LEADER
I20260811 07:08:18.797667 23528 consensus_queue.cc:237] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d38e143d0102447c9e61f3fd4710c56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43985 } }
I20260811 07:08:18.798765 23516 sys_catalog.cc:564] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:18.800923 23530 sys_catalog.cc:455] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d38e143d0102447c9e61f3fd4710c56f. Latest consensus state: current_term: 1 leader_uuid: "d38e143d0102447c9e61f3fd4710c56f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d38e143d0102447c9e61f3fd4710c56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43985 } } }
I20260811 07:08:18.801045 23529 sys_catalog.cc:455] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d38e143d0102447c9e61f3fd4710c56f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d38e143d0102447c9e61f3fd4710c56f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43985 } } }
I20260811 07:08:18.801326 23530 sys_catalog.cc:458] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:18.801445 23529 sys_catalog.cc:458] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:18.803264 23533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:18.813555 23533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:18.824266 23533 catalog_manager.cc:1347] Generated new cluster ID: 06f5abc2ad104c19bc9d38cdd970935a
I20260811 07:08:18.824460 23533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:18.835461 23533 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:18.835929 23533 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:18.850623 23533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d38e143d0102447c9e61f3fd4710c56f: Generated new TSK 0
I20260811 07:08:18.851658 23533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:18.862313 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23437
W20260811 07:08:18.863559 23511 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.162:52483
W20260811 07:08:18.864370 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23437: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:18.864564 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 23437
2026-08-11T07:08:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2216 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:19 dist-test-slave-69rg krb5kdc[23552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:19 dist-test-slave-69rg krb5kdc[23552](info): set up 2 sockets
Aug 11 07:08:19 dist-test-slave-69rg krb5kdc[23552](info): commencing operation
krb5kdc: starting...
W20260811 07:08:20.122010 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.006s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:20 dist-test-slave-69rg krb5kdc[23552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:08:20.473768 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:34985
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:38449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:34985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:20.836050 23567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:20.836356 23567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:20.836520 23567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:20.844416 23567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:20.844661 23567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:20.844755 23567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:20.844846 23567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:20.844913 23567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:20.855314 23567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:38449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:34985
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:34985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:20.856822 23567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:20.858372 23567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:20.872165 23572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:20.872228 23573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:20.872260 23575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:20.873242 23567 server_base.cc:1034] running on GCE node
I20260811 07:08:20.874248 23567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:20.876016 23567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:20.877295 23567 hybrid_clock.cc:648] HybridClock initialized: now 1786432100877254 us; error 51 us; skew 500 ppm
I20260811 07:08:20.877697 23567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:20 dist-test-slave-69rg krb5kdc[23552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432100, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:20.881266 23567 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:08:20.882905 23567 webserver.cc:460] Webserver started at http://127.30.73.126:34033/ using document root <none> and password file <none>
I20260811 07:08:20.883665 23567 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:20.883816 23567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:20.884140 23567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:20.887252 23567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "f1d81efaa7284a9786a4f403ed711ac9"
format_stamp: "Formatted at 2026-08-11 07:08:20 on dist-test-slave-69rg"
server_key: "db26d6f42ebff63d707edcafe16c537a"
server_key_iv: "677aefc8da24009d8dfa6feec1d4fbd1"
server_key_version: "encryptionkey@0"
I20260811 07:08:20.888025 23567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "f1d81efaa7284a9786a4f403ed711ac9"
format_stamp: "Formatted at 2026-08-11 07:08:20 on dist-test-slave-69rg"
server_key: "db26d6f42ebff63d707edcafe16c537a"
server_key_iv: "677aefc8da24009d8dfa6feec1d4fbd1"
server_key_version: "encryptionkey@0"
I20260811 07:08:20.893388 23567 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.006s
I20260811 07:08:20.897058 23583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:20.898523 23567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:08:20.898712 23567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "f1d81efaa7284a9786a4f403ed711ac9"
format_stamp: "Formatted at 2026-08-11 07:08:20 on dist-test-slave-69rg"
server_key: "db26d6f42ebff63d707edcafe16c537a"
server_key_iv: "677aefc8da24009d8dfa6feec1d4fbd1"
server_key_version: "encryptionkey@0"
I20260811 07:08:20.898914 23567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:20.916486 23567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:20.921196 23567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:20.921532 23567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:20.945012 23567 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:34985
I20260811 07:08:20.945022 23640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:34985 every 8 connection(s)
I20260811 07:08:20.947752 23567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:20.952805 23641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:20.957782 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 23567
I20260811 07:08:20.958081 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:20.958644 31013 external_mini_cluster.cc:1428] Setting key f10cfcde0495dc175a54f685cb467950
I20260811 07:08:20.965305 23641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9: Bootstrap starting.
I20260811 07:08:20.968732 23641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:20.969991 23641 log.cc:824] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:20.973464 23641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9: No bootstrap required, opened a new log
Aug 11 07:08:20 dist-test-slave-69rg krb5kdc[23552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:08:20.982650 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:20.960673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38915 (local address 127.30.73.126:34985)
0811 07:08:20.961539 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:20.961551 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:20.961595 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:08:20.963818 (+ 2223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:20.963840 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:20.964233 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:20.964622 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:20.966263 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:20.967564 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:20.968806 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:20.969529 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:20.969745 (+ 216us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:20.974855 (+ 5110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:20.974863 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:20.974878 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:20.974917 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:20.978177 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:20.979017 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:20.979024 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:20.979030 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:20.979216 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:20.979778 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:20.979782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:20.979785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:20.980363 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:20.980767 (+ 404us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:20.981297 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 07:08:20.981624 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":401,"threads_started":1}
I20260811 07:08:20.982478 23641 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d81efaa7284a9786a4f403ed711ac9" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34985 } }
I20260811 07:08:20.982947 23641 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:20.983094 23641 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1d81efaa7284a9786a4f403ed711ac9, State: Initialized, Role: FOLLOWER
I20260811 07:08:20.983799 23641 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d81efaa7284a9786a4f403ed711ac9" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34985 } }
I20260811 07:08:20.984138 23641 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:20.984323 23641 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:20.984529 23641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:20.986936 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:20.987651 23641 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d81efaa7284a9786a4f403ed711ac9" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34985 } }
I20260811 07:08:20.988158 23641 leader_election.cc:302] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1d81efaa7284a9786a4f403ed711ac9; no voters:
I20260811 07:08:20.988775 23641 leader_election.cc:288] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:20.988945 23646 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:20.990302 23646 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [term 1 LEADER]: Becoming Leader. State: Replica: f1d81efaa7284a9786a4f403ed711ac9, State: Running, Role: LEADER
I20260811 07:08:20.991092 23646 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d81efaa7284a9786a4f403ed711ac9" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34985 } }
I20260811 07:08:20.991369 23641 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:20.995285 23649 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1d81efaa7284a9786a4f403ed711ac9. Latest consensus state: current_term: 1 leader_uuid: "f1d81efaa7284a9786a4f403ed711ac9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d81efaa7284a9786a4f403ed711ac9" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34985 } } }
I20260811 07:08:20.995304 23647 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1d81efaa7284a9786a4f403ed711ac9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d81efaa7284a9786a4f403ed711ac9" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 34985 } } }
I20260811 07:08:20.995945 23649 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:20.995949 23647 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:21.006604 23660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:21.013587 23660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:21.022806 23672 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:08:21.023280 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:20.993238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54743 (local address 127.30.73.126:34985)
0811 07:08:20.993434 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:20.993440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:21.002767 (+ 9327us) server_negotiation.cc:407] Connection header received
0811 07:08:21.003042 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:21.003051 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:21.003162 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:21.003292 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:21.005590 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:21.007052 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:21.009125 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:21.009914 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:21.010086 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:21.014019 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:21.014027 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:21.014032 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:21.014081 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:21.018435 (+ 4354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:21.019688 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:21.019694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:21.019697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:21.019856 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:21.020453 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:21.020457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:21.020460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:21.020939 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:21.021212 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:21.022522 (+ 1310us) server_negotiation.cc:299] Negotiation successful
0811 07:08:21.022728 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:08:21.025712 23660 catalog_manager.cc:1347] Generated new cluster ID: 936ba4c912a749c79394ffff38082183
I20260811 07:08:21.025842 23660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:21.049501 23660 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:21.051033 23660 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:21.059803 23660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1d81efaa7284a9786a4f403ed711ac9: Generated new TSK 0
I20260811 07:08:21.060670 23660 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:21.073957 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23567
I20260811 07:08:21.075800 23636 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:21.172024 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 23567
W20260811 07:08:21.196803 23549 connection.cc:535] client connection to 127.30.73.126:34985 recv error: Network error: failed to read from TLS socket (remote: 127.30.73.126:34985): Connection reset by peer (error 104)
2026-08-11T07:08:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2305 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:21 dist-test-slave-69rg krb5kdc[23679](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:21 dist-test-slave-69rg krb5kdc[23679](info): set up 2 sockets
Aug 11 07:08:21 dist-test-slave-69rg krb5kdc[23679](info): commencing operation
krb5kdc: starting...
W20260811 07:08:22.447499 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.007s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:22 dist-test-slave-69rg krb5kdc[23679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:08:22.801800 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:41367
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:41367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:23.172356 23697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:23.172652 23697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:23.172832 23697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:23.180572 23697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:23.180718 23697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:23.180819 23697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:23.180917 23697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:23.180982 23697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:23.192785 23697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:41367
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:41367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:23.194469 23697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:23.195907 23697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:23.208426 23704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:23.208375 23703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:23.208465 23706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:23.210289 23697 server_base.cc:1034] running on GCE node
I20260811 07:08:23.211167 23697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:23.212797 23697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:23.214051 23697 hybrid_clock.cc:648] HybridClock initialized: now 1786432103214071 us; error 100 us; skew 500 ppm
I20260811 07:08:23.214462 23697 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:23 dist-test-slave-69rg krb5kdc[23679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432103, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:23.217792 23697 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:08:23.219498 23697 webserver.cc:460] Webserver started at http://127.30.73.126:34807/ using document root <none> and password file <none>
I20260811 07:08:23.220227 23697 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:23.220377 23697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:23.220703 23697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:23.223850 23697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "ee442e3b22f24499a7dbc6bfe2f26413"
format_stamp: "Formatted at 2026-08-11 07:08:23 on dist-test-slave-69rg"
server_key: "ac86eb14b24afba2c7539db058035443"
server_key_iv: "f83ef832adbf3e0f3d37574b189c4348"
server_key_version: "encryptionkey@0"
I20260811 07:08:23.224638 23697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "ee442e3b22f24499a7dbc6bfe2f26413"
format_stamp: "Formatted at 2026-08-11 07:08:23 on dist-test-slave-69rg"
server_key: "ac86eb14b24afba2c7539db058035443"
server_key_iv: "f83ef832adbf3e0f3d37574b189c4348"
server_key_version: "encryptionkey@0"
I20260811 07:08:23.230240 23697 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 07:08:23.234047 23715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:23.235576 23697 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:08:23.235778 23697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "ee442e3b22f24499a7dbc6bfe2f26413"
format_stamp: "Formatted at 2026-08-11 07:08:23 on dist-test-slave-69rg"
server_key: "ac86eb14b24afba2c7539db058035443"
server_key_iv: "f83ef832adbf3e0f3d37574b189c4348"
server_key_version: "encryptionkey@0"
I20260811 07:08:23.235993 23697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:23.250115 23697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:23.254869 23697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:23.255180 23697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:23.277526 23697 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:41367
I20260811 07:08:23.277563 23775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:41367 every 8 connection(s)
I20260811 07:08:23.279055 23697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:23.283248 23776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:23.289198 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 23697
I20260811 07:08:23.289403 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:23.289892 31013 external_mini_cluster.cc:1428] Setting key 86acc13e9860d188ed79b79a72297e69
I20260811 07:08:23.294746 23776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413: Bootstrap starting.
I20260811 07:08:23.298626 23776 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:23.300038 23776 log.cc:824] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:23.303642 23776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413: No bootstrap required, opened a new log
I20260811 07:08:23.305009 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:23.291911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46139 (local address 127.30.73.126:41367)
0811 07:08:23.292824 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:23.292835 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:23.292876 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:08:23.294669 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:23.294693 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:23.295122 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:23.295433 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:23.296131 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:23.297733 (+ 1602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:23.299890 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:23.300959 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:23.301201 (+ 242us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:23.302529 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:23.302537 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:23.302553 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:23.303204 (+ 651us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:23.303290 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:23.303318 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:23.303456 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:23.303832 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 07:08:23.303981 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":441,"threads_started":1}
I20260811 07:08:23.310034 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:23.312371 23776 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee442e3b22f24499a7dbc6bfe2f26413" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41367 } }
I20260811 07:08:23.312927 23776 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:23.313051 23776 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee442e3b22f24499a7dbc6bfe2f26413, State: Initialized, Role: FOLLOWER
I20260811 07:08:23.313853 23776 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee442e3b22f24499a7dbc6bfe2f26413" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41367 } }
I20260811 07:08:23.314131 23776 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:23.314294 23776 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:23.314495 23776 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:23.317900 23776 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee442e3b22f24499a7dbc6bfe2f26413" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41367 } }
I20260811 07:08:23.318497 23776 leader_election.cc:302] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee442e3b22f24499a7dbc6bfe2f26413; no voters:
I20260811 07:08:23.319144 23776 leader_election.cc:288] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:23.319293 23786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:23.319958 23786 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [term 1 LEADER]: Becoming Leader. State: Replica: ee442e3b22f24499a7dbc6bfe2f26413, State: Running, Role: LEADER
I20260811 07:08:23.320595 23786 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee442e3b22f24499a7dbc6bfe2f26413" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41367 } }
I20260811 07:08:23.323926 23776 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:23.324448 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:23.314740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33127 (local address 127.30.73.126:41367)
0811 07:08:23.314969 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:23.314976 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:23.315528 (+ 552us) server_negotiation.cc:407] Connection header received
0811 07:08:23.315681 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:23.315692 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:23.315776 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:23.315913 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:23.316544 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:23.317685 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:23.319674 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:23.320812 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:23.321041 (+ 229us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:23.322807 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:23.322819 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:23.322823 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:23.322850 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:23.322911 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:23.322943 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:23.323108 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:23.323959 (+ 851us) server_negotiation.cc:299] Negotiation successful
0811 07:08:23.324024 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:08:23.324800 23787 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee442e3b22f24499a7dbc6bfe2f26413. Latest consensus state: current_term: 1 leader_uuid: "ee442e3b22f24499a7dbc6bfe2f26413" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee442e3b22f24499a7dbc6bfe2f26413" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41367 } } }
I20260811 07:08:23.325250 23787 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:23.326786 23791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:23.327325 23788 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee442e3b22f24499a7dbc6bfe2f26413" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee442e3b22f24499a7dbc6bfe2f26413" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41367 } } }
I20260811 07:08:23.327648 23788 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:23.332261 23791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:23.342816 23791 catalog_manager.cc:1347] Generated new cluster ID: 6064417a51114e8487d40609624af99b
I20260811 07:08:23.342970 23791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:23.368868 23791 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:23.370884 23791 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:23.382395 23791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee442e3b22f24499a7dbc6bfe2f26413: Generated new TSK 0
I20260811 07:08:23.383639 23791 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:23.395319 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23697
W20260811 07:08:23.397218 23769 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46139
W20260811 07:08:23.398231 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23697: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:23.398494 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 23697
W20260811 07:08:23.421809 23675 connection.cc:535] client connection to 127.30.73.126:41367 recv error: Network error: failed to read from TLS socket (remote: 127.30.73.126:41367): Connection reset by peer (error 104)
2026-08-11T07:08:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2224 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:23 dist-test-slave-69rg krb5kdc[23807](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:23 dist-test-slave-69rg krb5kdc[23807](info): set up 2 sockets
Aug 11 07:08:23 dist-test-slave-69rg krb5kdc[23807](info): commencing operation
krb5kdc: starting...
W20260811 07:08:24.642141 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.002s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:24 dist-test-slave-69rg krb5kdc[23807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
W20260811 07:08:25.102528 31013 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.30.73.126: real 0.100s user 0.002s sys 0.038s
I20260811 07:08:25.104048 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35735
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:35735
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:25.511267 23820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:25.511678 23820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:25.511855 23820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:25.519927 23820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:25.520114 23820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:25.520233 23820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:25.520354 23820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:25.520445 23820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:25.531796 23820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:35735
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:35735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:25.533289 23820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:25.534783 23820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:25.547854 23826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:25.547894 23827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:25.548413 23820 server_base.cc:1034] running on GCE node
W20260811 07:08:25.548458 23829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:25.549304 23820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:25.550797 23820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:25.552070 23820 hybrid_clock.cc:648] HybridClock initialized: now 1786432105552018 us; error 38 us; skew 500 ppm
I20260811 07:08:25.552484 23820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:25 dist-test-slave-69rg krb5kdc[23807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432105, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:25.561115 23820 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:08:25.562889 23820 webserver.cc:460] Webserver started at http://127.30.73.126:40577/ using document root <none> and password file <none>
I20260811 07:08:25.563621 23820 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:25.563774 23820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:25.564105 23820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:25.567302 23820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "4e18c7cc00a54bc3ba801c467507a700"
format_stamp: "Formatted at 2026-08-11 07:08:25 on dist-test-slave-69rg"
server_key: "8b0f1a520037892308ab04787526b27f"
server_key_iv: "55d50c0806be6fe1889127540d7839ad"
server_key_version: "encryptionkey@0"
I20260811 07:08:25.568115 23820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "4e18c7cc00a54bc3ba801c467507a700"
format_stamp: "Formatted at 2026-08-11 07:08:25 on dist-test-slave-69rg"
server_key: "8b0f1a520037892308ab04787526b27f"
server_key_iv: "55d50c0806be6fe1889127540d7839ad"
server_key_version: "encryptionkey@0"
I20260811 07:08:25.573537 23820 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:08:25.577122 23837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:25.578694 23820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:08:25.578910 23820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "4e18c7cc00a54bc3ba801c467507a700"
format_stamp: "Formatted at 2026-08-11 07:08:25 on dist-test-slave-69rg"
server_key: "8b0f1a520037892308ab04787526b27f"
server_key_iv: "55d50c0806be6fe1889127540d7839ad"
server_key_version: "encryptionkey@0"
I20260811 07:08:25.579147 23820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:25.585650 23820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:25.590384 23820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:25.590757 23820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:25.611152 23820 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:35735
I20260811 07:08:25.611191 23899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:35735 every 8 connection(s)
I20260811 07:08:25.612619 23820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:25.614689 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 23820
I20260811 07:08:25.614900 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:25.615530 31013 external_mini_cluster.cc:1428] Setting key a12530782a1da30922812e525f0c9855
I20260811 07:08:25.617954 23900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:25.623821 23904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:25.617593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58483 (local address 127.30.73.126:35735)
0811 07:08:25.618522 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:25.618534 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:25.618579 (+ 45us) server_negotiation.cc:407] Connection header received
0811 07:08:25.620305 (+ 1726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:25.620327 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:25.620656 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:25.621071 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:25.622175 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:25.622181 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:25.622193 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:25.622228 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:25.622300 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:25.622319 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:25.622565 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:25.622715 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 07:08:25.622890 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":449,"threads_started":1}
I20260811 07:08:25.627547 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:25.630715 23900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700: Bootstrap starting.
I20260811 07:08:25.634756 23900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:25.634856 23904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:25.631926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55769 (local address 127.30.73.126:35735)
0811 07:08:25.632120 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:25.632126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:25.632656 (+ 530us) server_negotiation.cc:407] Connection header received
0811 07:08:25.632788 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:25.632794 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:25.632876 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:25.632996 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:25.634046 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:25.634052 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:25.634057 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:25.634077 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:25.634127 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:25.634149 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:25.634278 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:25.634507 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 07:08:25.634556 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:08:25.636054 23900 log.cc:824] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:25.638932 23900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700: No bootstrap required, opened a new log
I20260811 07:08:25.646690 23900 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e18c7cc00a54bc3ba801c467507a700" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35735 } }
I20260811 07:08:25.647075 23900 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:25.647188 23900 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e18c7cc00a54bc3ba801c467507a700, State: Initialized, Role: FOLLOWER
I20260811 07:08:25.647718 23900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e18c7cc00a54bc3ba801c467507a700" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35735 } }
I20260811 07:08:25.647953 23900 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:25.648102 23900 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:25.648284 23900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:25.650799 23900 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e18c7cc00a54bc3ba801c467507a700" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35735 } }
I20260811 07:08:25.651285 23900 leader_election.cc:302] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e18c7cc00a54bc3ba801c467507a700; no voters:
I20260811 07:08:25.651880 23900 leader_election.cc:288] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:25.652012 23913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:25.652774 23913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [term 1 LEADER]: Becoming Leader. State: Replica: 4e18c7cc00a54bc3ba801c467507a700, State: Running, Role: LEADER
I20260811 07:08:25.653378 23913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e18c7cc00a54bc3ba801c467507a700" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35735 } }
I20260811 07:08:25.653988 23900 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:25.656744 23915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e18c7cc00a54bc3ba801c467507a700. Latest consensus state: current_term: 1 leader_uuid: "4e18c7cc00a54bc3ba801c467507a700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e18c7cc00a54bc3ba801c467507a700" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35735 } } }
I20260811 07:08:25.656957 23914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e18c7cc00a54bc3ba801c467507a700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e18c7cc00a54bc3ba801c467507a700" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 35735 } } }
I20260811 07:08:25.657297 23915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:25.657356 23914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:25.661804 23919 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:25.667622 23919 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:25.676513 23919 catalog_manager.cc:1347] Generated new cluster ID: 9252e34834b7483687175b5d564fb980
I20260811 07:08:25.676687 23919 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:25.690125 23919 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:25.690585 23919 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:25.698172 23919 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e18c7cc00a54bc3ba801c467507a700: Generated new TSK 0
I20260811 07:08:25.698997 23919 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:25.710070 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23820
W20260811 07:08:25.711282 23895 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58483
W20260811 07:08:25.711987 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23820: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:25.712159 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 23820
2026-08-11T07:08:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2310 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:25 dist-test-slave-69rg krb5kdc[23937](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:25 dist-test-slave-69rg krb5kdc[23937](info): set up 2 sockets
Aug 11 07:08:25 dist-test-slave-69rg krb5kdc[23937](info): commencing operation
krb5kdc: starting...
W20260811 07:08:26.931468 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.005s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:27 dist-test-slave-69rg krb5kdc[23937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:08:27.281217 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:41583
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:41583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:27.644201 23950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:27.644507 23950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:27.644603 23950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:27.651822 23950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:27.651947 23950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:27.651997 23950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:27.652068 23950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:27.652114 23950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:27.662109 23950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:41583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:41583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:27.663446 23950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:27.664747 23950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:27.677259 23955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:27.677271 23956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:27.677246 23958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:27.678220 23950 server_base.cc:1034] running on GCE node
I20260811 07:08:27.679045 23950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:27.680454 23950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:27.681659 23950 hybrid_clock.cc:648] HybridClock initialized: now 1786432107681619 us; error 42 us; skew 500 ppm
I20260811 07:08:27.682060 23950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:27 dist-test-slave-69rg krb5kdc[23937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432107, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:27.685242 23950 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:08:27.686861 23950 webserver.cc:460] Webserver started at http://127.30.73.126:44125/ using document root <none> and password file <none>
I20260811 07:08:27.687570 23950 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:27.687721 23950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:27.688050 23950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:27.691124 23950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "82cfbdaf7712418a93e7c6544e5f2137"
format_stamp: "Formatted at 2026-08-11 07:08:27 on dist-test-slave-69rg"
server_key: "a3047d5f7419382f28b64f39b708234b"
server_key_iv: "4be42962c2d78abeed9ee4c52382ad0d"
server_key_version: "encryptionkey@0"
I20260811 07:08:27.691928 23950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "82cfbdaf7712418a93e7c6544e5f2137"
format_stamp: "Formatted at 2026-08-11 07:08:27 on dist-test-slave-69rg"
server_key: "a3047d5f7419382f28b64f39b708234b"
server_key_iv: "4be42962c2d78abeed9ee4c52382ad0d"
server_key_version: "encryptionkey@0"
I20260811 07:08:27.697489 23950 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 07:08:27.701192 23966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:27.702585 23950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:08:27.702785 23950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "82cfbdaf7712418a93e7c6544e5f2137"
format_stamp: "Formatted at 2026-08-11 07:08:27 on dist-test-slave-69rg"
server_key: "a3047d5f7419382f28b64f39b708234b"
server_key_iv: "4be42962c2d78abeed9ee4c52382ad0d"
server_key_version: "encryptionkey@0"
I20260811 07:08:27.702991 23950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:27.717927 23950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:27.722364 23950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:27.722658 23950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:27.742297 23950 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:41583
I20260811 07:08:27.742331 24024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:41583 every 8 connection(s)
I20260811 07:08:27.743708 23950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:27.744987 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 23950
I20260811 07:08:27.745180 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:27.745759 31013 external_mini_cluster.cc:1428] Setting key 892e57755e331205029c65139d220961
I20260811 07:08:27.749017 24025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:08:27 dist-test-slave-69rg krb5kdc[23937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:08:27.760371 24025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137: Bootstrap starting.
I20260811 07:08:27.764860 24025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:27.766243 24025 log.cc:824] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:27.769768 24025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137: No bootstrap required, opened a new log
I20260811 07:08:27.769936 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:27.747716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48257 (local address 127.30.73.126:41583)
0811 07:08:27.748476 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:27.748488 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:27.748527 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:08:27.750247 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:27.750268 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:27.750650 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:27.751017 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:27.752546 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:27.753940 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:27.755210 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:27.755880 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:27.756070 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:27.760969 (+ 4899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:27.760981 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:27.761000 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:27.761053 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:27.765261 (+ 4208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:27.766039 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:27.766049 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:27.766058 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:27.766278 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:27.766706 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:27.766713 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:27.766719 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:27.767384 (+ 665us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:27.767641 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:27.768119 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 07:08:27.768591 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":337,"threads_started":1}
I20260811 07:08:27.773972 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:27.778522 24025 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cfbdaf7712418a93e7c6544e5f2137" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41583 } }
I20260811 07:08:27.779000 24025 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:27.779120 24025 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82cfbdaf7712418a93e7c6544e5f2137, State: Initialized, Role: FOLLOWER
I20260811 07:08:27.779955 24025 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cfbdaf7712418a93e7c6544e5f2137" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41583 } }
I20260811 07:08:27.780253 24025 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:27.780405 24025 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:27.780596 24025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:27.783727 24025 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cfbdaf7712418a93e7c6544e5f2137" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41583 } }
I20260811 07:08:27.784276 24025 leader_election.cc:302] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82cfbdaf7712418a93e7c6544e5f2137; no voters:
I20260811 07:08:27.784937 24025 leader_election.cc:288] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:27.785013 24038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:27.786298 24038 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [term 1 LEADER]: Becoming Leader. State: Replica: 82cfbdaf7712418a93e7c6544e5f2137, State: Running, Role: LEADER
I20260811 07:08:27.786996 24038 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cfbdaf7712418a93e7c6544e5f2137" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41583 } }
I20260811 07:08:27.787202 24025 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:27.791596 24039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82cfbdaf7712418a93e7c6544e5f2137" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cfbdaf7712418a93e7c6544e5f2137" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41583 } } }
I20260811 07:08:27.791729 24040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82cfbdaf7712418a93e7c6544e5f2137. Latest consensus state: current_term: 1 leader_uuid: "82cfbdaf7712418a93e7c6544e5f2137" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cfbdaf7712418a93e7c6544e5f2137" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 41583 } } }
I20260811 07:08:27.792104 24039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:27.792116 24040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:27.793124 24045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:27.798237 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:27.778392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44269 (local address 127.30.73.126:41583)
0811 07:08:27.778601 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:27.778607 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:27.779183 (+ 576us) server_negotiation.cc:407] Connection header received
0811 07:08:27.779384 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:27.779390 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:27.779477 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:27.779588 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:27.781467 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:27.782692 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:27.783943 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:27.784418 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:27.784558 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:27.788018 (+ 3460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:27.788025 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:27.788030 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:27.788067 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:27.793093 (+ 5026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:27.794059 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:27.794070 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:27.794074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:27.794314 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:27.794846 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:27.794851 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:27.794854 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:27.795281 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:27.797154 (+ 1873us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:27.797342 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 07:08:27.797662 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:08:27.806813 24045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:27.828630 24045 catalog_manager.cc:1347] Generated new cluster ID: c4030fdc3c064193a8f7c11844239394
I20260811 07:08:27.828780 24045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:27.848320 24045 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:27.850307 24045 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:27.861294 24045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82cfbdaf7712418a93e7c6544e5f2137: Generated new TSK 0
I20260811 07:08:27.862226 24045 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:27.869483 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 23950
I20260811 07:08:27.871223 24020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:27.964486 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 23950
2026-08-11T07:08:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2255 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:28 dist-test-slave-69rg krb5kdc[24064](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:28 dist-test-slave-69rg krb5kdc[24064](info): set up 2 sockets
Aug 11 07:08:28 dist-test-slave-69rg krb5kdc[24064](info): commencing operation
krb5kdc: starting...
W20260811 07:08:29.206395 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.010s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:29 dist-test-slave-69rg krb5kdc[24064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:08:29.586977 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40305
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:40161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:40305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:29.968858 24078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:29.969209 24078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:29.969309 24078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:29.976871 24078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:29.977005 24078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:29.977054 24078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:29.977123 24078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:29.977170 24078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:29.987629 24078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:40161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:40305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:40305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:29.989007 24078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:29.990386 24078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:30.003314 24087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:30.003618 24084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:30.003618 24085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:30.004801 24078 server_base.cc:1034] running on GCE node
I20260811 07:08:30.005963 24078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:30.007673 24078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:30.009052 24078 hybrid_clock.cc:648] HybridClock initialized: now 1786432110008975 us; error 69 us; skew 500 ppm
I20260811 07:08:30.009487 24078 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:30 dist-test-slave-69rg krb5kdc[24064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432110, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:30.013906 24078 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:08:30.015781 24078 webserver.cc:460] Webserver started at http://127.30.73.126:43325/ using document root <none> and password file <none>
I20260811 07:08:30.016826 24078 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:30.017010 24078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:30.017377 24078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:30.020875 24078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "68d54bc19c5e4b4481c87774c1cbf6ab"
format_stamp: "Formatted at 2026-08-11 07:08:30 on dist-test-slave-69rg"
server_key: "f4ae1dd47459004277678bdf4efe8e70"
server_key_iv: "07e81ba8616715309c904360cdfc346b"
server_key_version: "encryptionkey@0"
I20260811 07:08:30.022065 24078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "68d54bc19c5e4b4481c87774c1cbf6ab"
format_stamp: "Formatted at 2026-08-11 07:08:30 on dist-test-slave-69rg"
server_key: "f4ae1dd47459004277678bdf4efe8e70"
server_key_iv: "07e81ba8616715309c904360cdfc346b"
server_key_version: "encryptionkey@0"
I20260811 07:08:30.028851 24078 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s
I20260811 07:08:30.032927 24094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:30.034538 24078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:08:30.034762 24078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "68d54bc19c5e4b4481c87774c1cbf6ab"
format_stamp: "Formatted at 2026-08-11 07:08:30 on dist-test-slave-69rg"
server_key: "f4ae1dd47459004277678bdf4efe8e70"
server_key_iv: "07e81ba8616715309c904360cdfc346b"
server_key_version: "encryptionkey@0"
I20260811 07:08:30.034996 24078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:30.054719 24078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:30.060220 24078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:30.060567 24078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:30.086493 24078 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:40305
I20260811 07:08:30.086642 24149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:40305 every 8 connection(s)
I20260811 07:08:30.088228 24078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:30.092442 24150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:30.097011 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 24078
I20260811 07:08:30.097236 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:30.098121 31013 external_mini_cluster.cc:1428] Setting key de8437fe5e732a685d4da1f564d4a45a
I20260811 07:08:30.106129 24150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab: Bootstrap starting.
I20260811 07:08:30.110358 24150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:30.111879 24150 log.cc:824] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:30.115231 24150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab: No bootstrap required, opened a new log
I20260811 07:08:30.115437 24154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:30.100365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43261 (local address 127.30.73.126:40305)
0811 07:08:30.101473 (+ 1108us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:30.101491 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:30.102000 (+ 509us) server_negotiation.cc:407] Connection header received
0811 07:08:30.104656 (+ 2656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:30.104690 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:30.105296 (+ 606us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:30.105797 (+ 501us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:30.106400 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:30.108488 (+ 2088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:30.110150 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:30.111332 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:30.111581 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:30.112980 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:30.112988 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:30.113009 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:30.113595 (+ 586us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:30.113686 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:30.113713 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:30.113897 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:30.114096 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 07:08:30.114397 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":788,"thread_start_us":519,"threads_started":1}
I20260811 07:08:30.119978 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:30.124359 24150 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d54bc19c5e4b4481c87774c1cbf6ab" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40305 } }
I20260811 07:08:30.125054 24150 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:30.125221 24150 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68d54bc19c5e4b4481c87774c1cbf6ab, State: Initialized, Role: FOLLOWER
I20260811 07:08:30.126037 24150 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d54bc19c5e4b4481c87774c1cbf6ab" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40305 } }
I20260811 07:08:30.126333 24150 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:30.126495 24150 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:30.126710 24150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:30.129240 24150 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d54bc19c5e4b4481c87774c1cbf6ab" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40305 } }
I20260811 07:08:30.129900 24150 leader_election.cc:302] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68d54bc19c5e4b4481c87774c1cbf6ab; no voters:
I20260811 07:08:30.130729 24150 leader_election.cc:288] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:30.130856 24164 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:30.133633 24150 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:30.134299 24154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:30.125185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34461 (local address 127.30.73.126:40305)
0811 07:08:30.125437 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:30.125447 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:30.126039 (+ 592us) server_negotiation.cc:407] Connection header received
0811 07:08:30.126337 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:30.126346 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:30.126451 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:30.126578 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:30.127255 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:30.128118 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:30.129592 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:30.130288 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:30.130444 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:30.131878 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:30.131888 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:30.131897 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:30.131924 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:30.131976 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:30.132002 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:30.132102 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:30.132579 (+ 477us) server_negotiation.cc:299] Negotiation successful
0811 07:08:30.132670 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 07:08:30.134433 24164 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [term 1 LEADER]: Becoming Leader. State: Replica: 68d54bc19c5e4b4481c87774c1cbf6ab, State: Running, Role: LEADER
I20260811 07:08:30.135216 24164 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d54bc19c5e4b4481c87774c1cbf6ab" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40305 } }
I20260811 07:08:30.139115 24165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68d54bc19c5e4b4481c87774c1cbf6ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d54bc19c5e4b4481c87774c1cbf6ab" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40305 } } }
I20260811 07:08:30.139307 24166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68d54bc19c5e4b4481c87774c1cbf6ab. Latest consensus state: current_term: 1 leader_uuid: "68d54bc19c5e4b4481c87774c1cbf6ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d54bc19c5e4b4481c87774c1cbf6ab" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 40305 } } }
I20260811 07:08:30.139672 24165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:30.139741 24166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:30.141768 24169 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:30.147933 24169 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:30.161536 24169 catalog_manager.cc:1347] Generated new cluster ID: 646e47f7351b4814a2779873960a7f47
I20260811 07:08:30.161967 24169 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:30.170668 24169 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:30.172636 24169 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:30.189616 24169 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68d54bc19c5e4b4481c87774c1cbf6ab: Generated new TSK 0
I20260811 07:08:30.190699 24169 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:30.196656 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24078
W20260811 07:08:30.197954 24144 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43261
W20260811 07:08:30.198832 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24078: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:30.199028 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 24078
2026-08-11T07:08:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2235 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:30 dist-test-slave-69rg krb5kdc[24187](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:30 dist-test-slave-69rg krb5kdc[24187](info): set up 2 sockets
Aug 11 07:08:30 dist-test-slave-69rg krb5kdc[24187](info): commencing operation
krb5kdc: starting...
W20260811 07:08:31.482504 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.004s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:31 dist-test-slave-69rg krb5kdc[24187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:08:31.833479 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:45185
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:42825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:45185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:32.201288 24204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:32.201596 24204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:32.201781 24204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:32.209522 24204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:32.209646 24204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:32.209733 24204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:32.209861 24204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:32.209926 24204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:32.220075 24204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:42825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:45185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:45185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:32.221740 24204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:32.223570 24204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:32.236533 24213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:32.236594 24211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:32.236572 24209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:32.237617 24204 server_base.cc:1034] running on GCE node
I20260811 07:08:32.238577 24204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:32.240145 24204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:32.241452 24204 hybrid_clock.cc:648] HybridClock initialized: now 1786432112241377 us; error 109 us; skew 500 ppm
I20260811 07:08:32.242010 24204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:32 dist-test-slave-69rg krb5kdc[24187](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432112, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:32.252367 24204 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:08:32.254360 24204 webserver.cc:460] Webserver started at http://127.30.73.126:45189/ using document root <none> and password file <none>
I20260811 07:08:32.255188 24204 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:32.255357 24204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:32.255748 24204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:32.259181 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "d84b4dae3e0e4468b79350604c82bfde"
format_stamp: "Formatted at 2026-08-11 07:08:32 on dist-test-slave-69rg"
server_key: "05fd38027bb2531636ac46fe186d0ea0"
server_key_iv: "67c910511653456969b526a76ebaf108"
server_key_version: "encryptionkey@0"
I20260811 07:08:32.260030 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "d84b4dae3e0e4468b79350604c82bfde"
format_stamp: "Formatted at 2026-08-11 07:08:32 on dist-test-slave-69rg"
server_key: "05fd38027bb2531636ac46fe186d0ea0"
server_key_iv: "67c910511653456969b526a76ebaf108"
server_key_version: "encryptionkey@0"
I20260811 07:08:32.265755 24204 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:08:32.269773 24220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:32.271380 24204 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:08:32.271617 24204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "d84b4dae3e0e4468b79350604c82bfde"
format_stamp: "Formatted at 2026-08-11 07:08:32 on dist-test-slave-69rg"
server_key: "05fd38027bb2531636ac46fe186d0ea0"
server_key_iv: "67c910511653456969b526a76ebaf108"
server_key_version: "encryptionkey@0"
I20260811 07:08:32.271867 24204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:32.278640 24204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:32.283571 24204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:32.283927 24204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:32.305685 24204 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:45185
I20260811 07:08:32.305747 24276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:45185 every 8 connection(s)
I20260811 07:08:32.307191 24204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:32.308898 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 24204
I20260811 07:08:32.309100 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:32.309739 31013 external_mini_cluster.cc:1428] Setting key 2fd712285198793c1c866cd43247248a
I20260811 07:08:32.312263 24277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:32.318707 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:32.311869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45721 (local address 127.30.73.126:45185)
0811 07:08:32.312853 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:32.312867 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:32.312912 (+ 45us) server_negotiation.cc:407] Connection header received
0811 07:08:32.314826 (+ 1914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:32.314850 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:32.315217 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:32.315669 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:32.316825 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:32.316831 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:32.316844 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:32.316859 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:32.316940 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:32.316965 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:32.317248 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:32.317407 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 07:08:32.317606 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":727,"thread_start_us":461,"threads_started":1}
I20260811 07:08:32.322772 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:32.325278 24277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde: Bootstrap starting.
I20260811 07:08:32.329627 24277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:32.330400 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:32.327458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45809 (local address 127.30.73.126:45185)
0811 07:08:32.327697 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:32.327703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:32.328091 (+ 388us) server_negotiation.cc:407] Connection header received
0811 07:08:32.328283 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:32.328288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:32.328341 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:32.328435 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:32.329561 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:32.329565 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:32.329569 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:08:32.329585 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:32.329631 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:08:32.329646 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:32.329748 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:32.330006 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 07:08:32.330057 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 07:08:32.331172 24277 log.cc:824] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:32.334683 24277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde: No bootstrap required, opened a new log
I20260811 07:08:32.343400 24277 raft_consensus.cc:348] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d84b4dae3e0e4468b79350604c82bfde" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 45185 } }
I20260811 07:08:32.343878 24277 raft_consensus.cc:374] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:08:32.343997 24277 raft_consensus.cc:729] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d84b4dae3e0e4468b79350604c82bfde, State: Initialized, Role: FOLLOWER
I20260811 07:08:32.344599 24277 consensus_queue.cc:260] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d84b4dae3e0e4468b79350604c82bfde" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 45185 } }
I20260811 07:08:32.344857 24277 raft_consensus.cc:388] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:08:32.345016 24277 raft_consensus.cc:482] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:08:32.345203 24277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:32.347601 24277 raft_consensus.cc:504] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d84b4dae3e0e4468b79350604c82bfde" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 45185 } }
I20260811 07:08:32.348124 24277 leader_election.cc:302] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d84b4dae3e0e4468b79350604c82bfde; no voters:
I20260811 07:08:32.348904 24277 leader_election.cc:288] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:08:32.349042 24287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:32.349906 24287 raft_consensus.cc:686] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [term 1 LEADER]: Becoming Leader. State: Replica: d84b4dae3e0e4468b79350604c82bfde, State: Running, Role: LEADER
I20260811 07:08:32.350533 24287 consensus_queue.cc:237] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d84b4dae3e0e4468b79350604c82bfde" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 45185 } }
I20260811 07:08:32.351526 24277 sys_catalog.cc:564] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:32.353874 24289 sys_catalog.cc:455] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d84b4dae3e0e4468b79350604c82bfde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d84b4dae3e0e4468b79350604c82bfde" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 45185 } } }
I20260811 07:08:32.354513 24289 sys_catalog.cc:458] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:32.354317 24290 sys_catalog.cc:455] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [sys.catalog]: SysCatalogTable state changed. Reason: New leader d84b4dae3e0e4468b79350604c82bfde. Latest consensus state: current_term: 1 leader_uuid: "d84b4dae3e0e4468b79350604c82bfde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d84b4dae3e0e4468b79350604c82bfde" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 45185 } } }
I20260811 07:08:32.354660 24290 sys_catalog.cc:458] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:32.356391 24298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:32.362874 24298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:32.373956 24298 catalog_manager.cc:1347] Generated new cluster ID: 768380d0ab0442b3aa389d858268f39f
I20260811 07:08:32.374182 24298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:32.430786 24298 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:32.431419 24298 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:32.447784 24298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d84b4dae3e0e4468b79350604c82bfde: Generated new TSK 0
I20260811 07:08:32.448884 24298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:08:32.469650 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24204
W20260811 07:08:32.470818 24272 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45721
W20260811 07:08:32.471616 31013 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24204: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 07:08:32.471764 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 24204
2026-08-11T07:08:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2270 ms)
[----------] 18 tests from AuthTokenIssuingTest (40632 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:32 dist-test-slave-69rg krb5kdc[24314](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:32 dist-test-slave-69rg krb5kdc[24314](info): set up 2 sockets
Aug 11 07:08:32 dist-test-slave-69rg krb5kdc[24314](info): commencing operation
krb5kdc: starting...
W20260811 07:08:33.712582 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.005s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:33 dist-test-slave-69rg krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:08:34.147980 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:43283
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:43283,127.30.73.125:35045,127.30.73.124:44967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:34.586345 24330 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:08:34.586709 24330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:34.586777 24330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:34.586869 24330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:34.594422 24330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:34.594525 24330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:34.594584 24330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:34.594640 24330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:34.594704 24330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:34.605014 24330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:43283,127.30.73.125:35045,127.30.73.124:44967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:43283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:34.606441 24330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:34.607786 24330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:34.620599 24337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:34.620633 24338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:34.620812 24340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:34.621417 24330 server_base.cc:1034] running on GCE node
I20260811 07:08:34.622530 24330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:34.624192 24330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:34.625456 24330 hybrid_clock.cc:648] HybridClock initialized: now 1786432114625377 us; error 44 us; skew 500 ppm
I20260811 07:08:34.625952 24330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:34 dist-test-slave-69rg krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:34.629792 24330 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:08:34.631484 24330 webserver.cc:460] Webserver started at http://127.30.73.126:32931/ using document root <none> and password file <none>
I20260811 07:08:34.632280 24330 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:34.632421 24330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:34.632769 24330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:34.635993 24330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "360006836afb4b70a3f43b70f0ea18f1"
format_stamp: "Formatted at 2026-08-11 07:08:34 on dist-test-slave-69rg"
server_key: "dea1efb4a8954e43bbc00ba19730db44"
server_key_iv: "1321dda98af6755585b9d30cbf5ebe4e"
server_key_version: "encryptionkey@0"
I20260811 07:08:34.636839 24330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "360006836afb4b70a3f43b70f0ea18f1"
format_stamp: "Formatted at 2026-08-11 07:08:34 on dist-test-slave-69rg"
server_key: "dea1efb4a8954e43bbc00ba19730db44"
server_key_iv: "1321dda98af6755585b9d30cbf5ebe4e"
server_key_version: "encryptionkey@0"
I20260811 07:08:34.642539 24330 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:08:34.646519 24348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:34.648079 24330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:08:34.648314 24330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "360006836afb4b70a3f43b70f0ea18f1"
format_stamp: "Formatted at 2026-08-11 07:08:34 on dist-test-slave-69rg"
server_key: "dea1efb4a8954e43bbc00ba19730db44"
server_key_iv: "1321dda98af6755585b9d30cbf5ebe4e"
server_key_version: "encryptionkey@0"
I20260811 07:08:34.648567 24330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:34.676847 24330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:34.681777 24330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:34.682127 24330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:34.702998 24330 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:43283
I20260811 07:08:34.703056 24405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:43283 every 8 connection(s)
I20260811 07:08:34.704520 24330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:34.708956 24406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:34.714232 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 24330
I20260811 07:08:34.714478 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:34.715166 31013 external_mini_cluster.cc:1428] Setting key f48bc59e82bf646991ea218bbd1af16e
I20260811 07:08:34.716804 24406 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:08:34 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:08:34.741348 24409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.720498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49588 (local address 127.30.73.126:43283)
0811 07:08:34.722310 (+ 1812us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:34.722320 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:34.722377 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:08:34.724039 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:34.724045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:34.724298 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:34.724512 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:34.725903 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:34.727112 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:34.728521 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:34.729071 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:34.729296 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:34.733597 (+ 4301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:34.733607 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:34.733624 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:34.733655 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:34.736648 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:34.737404 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:34.737410 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:34.737412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:34.737560 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:34.738038 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:34.738048 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:34.738050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:34.738624 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:34.738848 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:34.739435 (+ 587us) server_negotiation.cc:299] Negotiation successful
0811 07:08:34.739776 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":1568,"thread_start_us":1336,"threads_started":1}
I20260811 07:08:34.741390 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.720498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43283 (local address 127.0.0.1:49588)
0811 07:08:34.721424 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:34.721482 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:34.723607 (+ 2125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:34.724538 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:34.724544 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:34.725295 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:34.725632 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:34.725648 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:34.727287 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:34.727294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:34.728372 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:34.728385 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:34.729338 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:34.729345 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:34.729588 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:34.730363 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:34.730385 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:34.733331 (+ 2946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:34.736802 (+ 3471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:34.736816 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:34.736830 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:34.737254 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:34.737686 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:34.737693 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:34.737697 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:34.737921 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:34.738782 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:34.738790 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:34.739032 (+ 242us) client_negotiation.cc:769] Sending connection context
0811 07:08:34.739293 (+ 261us) client_negotiation.cc:240] Negotiation successful
0811 07:08:34.739905 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"mutex_wait_us":154,"thread_start_us":392,"threads_started":1}
I20260811 07:08:34.744843 24406 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:08:34.746412 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.745957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52274)
0811 07:08:34.746151 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:34.746285 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 07:08:34.746771 24349 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
I20260811 07:08:34.748433 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.748065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52284)
0811 07:08:34.748231 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:34.748300 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 07:08:34.748646 24406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:35045: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.30.73.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab.
Entry for principal kudu/127.30.73.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab.
I20260811 07:08:34.794698 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.125:35045
--webserver_interface=127.30.73.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab
--principal=kudu/127.30.73.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:43283,127.30.73.125:35045,127.30.73.124:44967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:08:34.798050 24406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } attempt: 1
I20260811 07:08:34.799346 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.798839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52300)
0811 07:08:34.799056 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:34.799182 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 07:08:34.800428 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.800060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52316)
0811 07:08:34.800217 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:34.800297 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 07:08:34.800773 24406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:35045: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
I20260811 07:08:34.869095 24406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } attempt: 2
I20260811 07:08:34.870501 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.869991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52318)
0811 07:08:34.870240 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:34.870359 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 07:08:34.871603 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.871218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52326)
0811 07:08:34.871380 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:34.871472 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 07:08:34.871805 24406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:35045: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
I20260811 07:08:34.963097 24406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } attempt: 3
I20260811 07:08:34.964952 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.964134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52334)
0811 07:08:34.964415 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:34.964767 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260811 07:08:34.966320 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:34.965810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52338)
0811 07:08:34.966055 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:34.966144 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 07:08:34.966560 24406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:35045: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
I20260811 07:08:35.109952 24406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } attempt: 4
I20260811 07:08:35.111338 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.110682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52348)
0811 07:08:35.111083 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.111174 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194}
I20260811 07:08:35.113111 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.112355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52356)
0811 07:08:35.112849 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.112959 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
W20260811 07:08:35.113343 24406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:35045: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
W20260811 07:08:35.267781 24414 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:08:35.268232 24414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:35.268358 24414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:35.268494 24414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:35.277926 24414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:35.278252 24414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:35.278429 24414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:35.278718 24414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:35.279258 24414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:35.294201 24414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:43283,127.30.73.125:35045,127.30.73.124:44967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab
--principal=kudu/127.30.73.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.125:35045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.73.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:35.296463 24414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:35.298096 24414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:35.317610 24419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:35.317781 24420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:35.319407 24424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:35.321416 24414 server_base.cc:1034] running on GCE node
I20260811 07:08:35.323483 24414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:35.326182 24414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:35.327690 24414 hybrid_clock.cc:648] HybridClock initialized: now 1786432115327589 us; error 76 us; skew 500 ppm
I20260811 07:08:35.328333 24414 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:35 dist-test-slave-69rg krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432115, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:35.334143 24414 init.cc:377] Logged in from keytab as kudu/127.30.73.125@KRBTEST.COM (short username kudu)
I20260811 07:08:35.336091 24414 webserver.cc:460] Webserver started at http://127.30.73.125:43705/ using document root <none> and password file <none>
I20260811 07:08:35.336951 24414 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:35.337129 24414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:35.337810 24414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:35.343318 24414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/data/instance:
uuid: "a907710de3894aafb04749bc8a92a5c4"
format_stamp: "Formatted at 2026-08-11 07:08:35 on dist-test-slave-69rg"
server_key: "c70f7b7d2118bf5266e0d95468a5b66b"
server_key_iv: "0a363c129773269308d515b4c79aead6"
server_key_version: "encryptionkey@0"
I20260811 07:08:35.344318 24414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/wal/instance:
uuid: "a907710de3894aafb04749bc8a92a5c4"
format_stamp: "Formatted at 2026-08-11 07:08:35 on dist-test-slave-69rg"
server_key: "c70f7b7d2118bf5266e0d95468a5b66b"
server_key_iv: "0a363c129773269308d515b4c79aead6"
server_key_version: "encryptionkey@0"
I20260811 07:08:35.352196 24414 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260811 07:08:35.356506 24432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:35.359230 24414 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:08:35.359738 24414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/wal
uuid: "a907710de3894aafb04749bc8a92a5c4"
format_stamp: "Formatted at 2026-08-11 07:08:35 on dist-test-slave-69rg"
server_key: "c70f7b7d2118bf5266e0d95468a5b66b"
server_key_iv: "0a363c129773269308d515b4c79aead6"
server_key_version: "encryptionkey@0"
I20260811 07:08:35.360008 24414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:35.386487 24414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:35.392921 24414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:35.393257 24414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:35.412765 24406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } attempt: 5
I20260811 07:08:35.414516 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.413653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52362)
0811 07:08:35.414024 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.414176 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260811 07:08:35.416172 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.415603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52368)
0811 07:08:35.415833 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.415950 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260811 07:08:35.416795 24406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:35045: Network error: Client connection negotiation failed: client connection to 127.30.73.125:35045: connect: Connection refused (error 111)
I20260811 07:08:35.420735 24414 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.125:35045
I20260811 07:08:35.420948 24489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.125:35045 every 8 connection(s)
I20260811 07:08:35.422381 24414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
I20260811 07:08:35.423622 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 24414
I20260811 07:08:35.423903 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-1/wal/instance
I20260811 07:08:35.424476 31013 external_mini_cluster.cc:1428] Setting key ed2551570b3295784ccaf37e428f9c41
I20260811 07:08:35.428138 24490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:35.440783 24490 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:08:35 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432115, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.73.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.124@KRBTEST.COM" created.
I20260811 07:08:35.472883 24494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.444600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49600 (local address 127.30.73.126:43283)
0811 07:08:35.445206 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:35.445215 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:35.446411 (+ 1196us) server_negotiation.cc:407] Connection header received
0811 07:08:35.449032 (+ 2621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:35.449042 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:35.449163 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:35.449319 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:35.451754 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.454222 (+ 2468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.456786 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.457988 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.458217 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:35.463604 (+ 5387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:35.463610 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:35.463614 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:35.463672 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:35.468146 (+ 4474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:35.469342 (+ 1196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:35.469347 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:35.469349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:35.469545 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:35.470375 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:35.470380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:35.470382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:35.470749 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:35.470900 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:35.472159 (+ 1259us) server_negotiation.cc:299] Negotiation successful
0811 07:08:35.472384 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":282,"threads_started":1}
I20260811 07:08:35.474661 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.445243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43283 (local address 127.0.0.1:49600)
0811 07:08:35.446197 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.446247 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:35.448515 (+ 2268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:35.449581 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:35.449589 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:35.450772 (+ 1183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:35.451406 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:35.451426 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.454861 (+ 3435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.454866 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:35.456290 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:35.456307 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.458476 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.458488 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:35.458924 (+ 436us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:35.459768 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:35.459795 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:35.463124 (+ 3329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:35.468346 (+ 5222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:35.468384 (+ 38us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:35.468408 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:35.469145 (+ 737us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:35.469785 (+ 640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:35.469794 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:35.469800 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:35.470166 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:35.470973 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:35.470980 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:35.471531 (+ 551us) client_negotiation.cc:769] Sending connection context
0811 07:08:35.472008 (+ 477us) client_negotiation.cc:240] Negotiation successful
0811 07:08:35.472698 (+ 690us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":388,"threads_started":1}
I20260811 07:08:35.476982 24490 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:08:35 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432115, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:08:35.495086 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.478267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52384 (local address 127.30.73.125:35045)
0811 07:08:35.479104 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:35.479186 (+ 82us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:35.479243 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:08:35.479304 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:35.479311 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:35.479539 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:35.479771 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:35.480675 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.482041 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.483319 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.483971 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.484121 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:35.487909 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:35.487932 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:35.487956 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:35.488018 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:35.491442 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:35.492374 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:35.492383 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:35.492385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:35.492546 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:35.493027 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:35.493031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:35.493033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:35.493525 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:35.493727 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:35.494331 (+ 604us) server_negotiation.cc:299] Negotiation successful
0811 07:08:35.494582 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":668,"thread_start_us":518,"threads_started":1}
I20260811 07:08:35.495133 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.477998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52384)
0811 07:08:35.478222 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.478246 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:35.478370 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:35.479758 (+ 1388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:35.479762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:35.480309 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:35.480469 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:35.480479 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.482197 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.482203 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:35.483164 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:35.483176 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.484158 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.484164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:35.484357 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:35.485112 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:35.485131 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:35.487635 (+ 2504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:35.491603 (+ 3968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:35.491612 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:35.491618 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:35.492200 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:35.492705 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:35.492713 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:35.492719 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:35.492910 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:35.493678 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:35.493686 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:35.493938 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 07:08:35.494121 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 07:08:35.494477 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 07:08:35.498512 24490 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:08:35.500123 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.499461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36882)
0811 07:08:35.499702 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.499876 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260811 07:08:35.500499 24434 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
I20260811 07:08:35.502645 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.502083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36886)
0811 07:08:35.502339 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.502461 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 07:08:35.503048 24490 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:44967: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab.
Entry for principal kudu/127.30.73.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab.
W20260811 07:08:35.525924 31013 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.30.73.124: real 0.101s user 0.000s sys 0.034s
I20260811 07:08:35.526791 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.124:44967
--webserver_interface=127.30.73.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab
--principal=kudu/127.30.73.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:45029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:43283,127.30.73.125:35045,127.30.73.124:44967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:08:35.552522 24490 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } attempt: 1
I20260811 07:08:35.554351 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.553630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36898)
0811 07:08:35.553941 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.554094 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 07:08:35.555917 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.555301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36906)
0811 07:08:35.555591 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.555721 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
W20260811 07:08:35.556296 24490 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:44967: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
I20260811 07:08:35.624603 24490 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } attempt: 2
I20260811 07:08:35.627079 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.626203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36920)
0811 07:08:35.626683 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.626833 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322}
I20260811 07:08:35.628345 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.627903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36934)
0811 07:08:35.628087 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.628186 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 07:08:35.628836 24490 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:44967: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
I20260811 07:08:35.720626 24490 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } attempt: 3
I20260811 07:08:35.722258 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.721650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36938)
0811 07:08:35.721943 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.722051 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260811 07:08:35.723798 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.723072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36948)
0811 07:08:35.723403 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.723519 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
W20260811 07:08:35.724268 24490 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:44967: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
I20260811 07:08:35.867537 24490 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } attempt: 4
I20260811 07:08:35.868853 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.868307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36962)
0811 07:08:35.868548 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.868642 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260811 07:08:35.870182 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.869652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36964)
0811 07:08:35.869885 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.869975 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260811 07:08:35.870441 24490 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:44967: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
W20260811 07:08:35.946499 24500 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:08:35.946928 24500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:35.947060 24500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:35.947206 24500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:35.955041 24500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:35.955196 24500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:35.955322 24500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:35.955412 24500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:35.955529 24500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:35.964143 24406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } attempt: 6
I20260811 07:08:35.967110 24500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:45029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:43283,127.30.73.125:35045,127.30.73.124:44967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab
--principal=kudu/127.30.73.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.124:44967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.73.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:35.968819 24500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:35.970777 24500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 11 07:08:35 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:08:35.981261 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.965096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52390 (local address 127.30.73.125:35045)
0811 07:08:35.965345 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:35.965352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:35.965710 (+ 358us) server_negotiation.cc:407] Connection header received
0811 07:08:35.965905 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:35.965910 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:35.965987 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:35.966079 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:35.967056 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.967906 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.969790 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.970460 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.970575 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:35.974722 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:35.974729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:35.974732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:35.974773 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:35.978305 (+ 3532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:35.979146 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:35.979151 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:35.979153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:35.979287 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:35.979722 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:35.979729 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:35.979732 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:35.980060 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:35.980243 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:35.980654 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 07:08:35.980886 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:08:35.981316 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.965021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52390)
0811 07:08:35.965555 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.965576 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:35.965730 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:35.966154 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:35.966161 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:35.966639 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:35.966876 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:35.966890 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.968065 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.968070 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:35.969553 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:35.969573 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:35.970657 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:35.970665 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:35.970900 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:35.971669 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:35.971695 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:35.974455 (+ 2760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:35.978483 (+ 4028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:35.978489 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:35.978494 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:35.978974 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:35.979433 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:35.979438 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:35.979442 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:35.979592 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:35.980206 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:35.980213 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:35.980387 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 07:08:35.980540 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 07:08:35.980874 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":279,"threads_started":1}
I20260811 07:08:35.982786 24406 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:08:35.983877 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.983460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36972)
0811 07:08:35.983653 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.983743 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 07:08:35.985399 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:35.984973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36974)
0811 07:08:35.985129 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:35.985230 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 07:08:35.985734 24406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:44967: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
W20260811 07:08:35.988305 24514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:35.988385 24511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:35.988356 24517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:35.989177 24500 server_base.cc:1034] running on GCE node
I20260811 07:08:35.990285 24500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:35.991848 24500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:35.993089 24500 hybrid_clock.cc:648] HybridClock initialized: now 1786432115992982 us; error 74 us; skew 500 ppm
I20260811 07:08:35.993582 24500 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:35 dist-test-slave-69rg krb5kdc[24314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432115, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:35.997465 24500 init.cc:377] Logged in from keytab as kudu/127.30.73.124@KRBTEST.COM (short username kudu)
I20260811 07:08:35.999308 24500 webserver.cc:460] Webserver started at http://127.30.73.124:33713/ using document root <none> and password file <none>
I20260811 07:08:36.000066 24500 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:36.000173 24500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:36.000515 24500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:36.004079 24500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/data/instance:
uuid: "aafd00cfb3f44b089d4eeb9dfe093c94"
format_stamp: "Formatted at 2026-08-11 07:08:35 on dist-test-slave-69rg"
server_key: "7f5e13030469824de994855cf94e825c"
server_key_iv: "971e68d7f82511583144c0055187516c"
server_key_version: "encryptionkey@0"
I20260811 07:08:36.004978 24500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/wal/instance:
uuid: "aafd00cfb3f44b089d4eeb9dfe093c94"
format_stamp: "Formatted at 2026-08-11 07:08:35 on dist-test-slave-69rg"
server_key: "7f5e13030469824de994855cf94e825c"
server_key_iv: "971e68d7f82511583144c0055187516c"
server_key_version: "encryptionkey@0"
I20260811 07:08:36.011468 24500 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 07:08:36.015981 24524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:36.017724 24500 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:08:36.018020 24500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/wal
uuid: "aafd00cfb3f44b089d4eeb9dfe093c94"
format_stamp: "Formatted at 2026-08-11 07:08:35 on dist-test-slave-69rg"
server_key: "7f5e13030469824de994855cf94e825c"
server_key_iv: "971e68d7f82511583144c0055187516c"
server_key_version: "encryptionkey@0"
I20260811 07:08:36.018313 24500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:36.037990 24406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } attempt: 1
I20260811 07:08:36.038872 24500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:36.039420 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.038803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36980)
0811 07:08:36.039111 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:36.039207 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260811 07:08:36.040828 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.040197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36982)
0811 07:08:36.040575 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:36.040676 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260811 07:08:36.041054 24406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:44967: Network error: Client connection negotiation failed: client connection to 127.30.73.124:44967: connect: Connection refused (error 111)
I20260811 07:08:36.043967 24500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:36.044214 24500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:36.074431 24500 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.124:44967
I20260811 07:08:36.074453 24582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.124:44967 every 8 connection(s)
I20260811 07:08:36.075969 24500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
I20260811 07:08:36.080268 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 24500
I20260811 07:08:36.080494 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786431722204153-31013-0/minicluster-data/master-2/wal/instance
I20260811 07:08:36.080583 24583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:36.081130 31013 external_mini_cluster.cc:1428] Setting key 557439292e43a867c3beaf76d364a876
I20260811 07:08:36.092633 24583 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:08:36 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
Aug 11 07:08:36 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432115, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:08:36.109970 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.083496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36988 (local address 127.30.73.124:44967)
0811 07:08:36.084517 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.084534 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.084589 (+ 55us) server_negotiation.cc:407] Connection header received
0811 07:08:36.086565 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.086591 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.087028 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.087406 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.089651 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.091613 (+ 1962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.093712 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.094564 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.094717 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.100704 (+ 5987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.100713 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.100730 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.100771 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.104753 (+ 3982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.105700 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.105716 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.105729 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.106005 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.106492 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.106496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.106498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.107282 (+ 784us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.107639 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.108091 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.108613 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":500,"threads_started":1}
I20260811 07:08:36.115054 24588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.096119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:43283 (local address 127.0.0.1:49610)
0811 07:08:36.097259 (+ 1140us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:36.097306 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:36.097488 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:36.098027 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:36.098034 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:36.099042 (+ 1008us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:36.099434 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.099451 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.101010 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.101016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.102904 (+ 1888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.102941 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.103743 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.103749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.103927 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.104786 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:36.104815 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:36.107628 (+ 2813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:36.111578 (+ 3950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.111588 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.111595 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.112322 (+ 727us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.112792 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.112797 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.112807 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.112939 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.113641 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:36.113649 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:36.113958 (+ 309us) client_negotiation.cc:769] Sending connection context
0811 07:08:36.114183 (+ 225us) client_negotiation.cc:240] Negotiation successful
0811 07:08:36.114723 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":867,"spinlock_wait_cycles":21376,"thread_start_us":697,"threads_started":1}
I20260811 07:08:36.115119 24587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.096105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49610 (local address 127.30.73.126:43283)
0811 07:08:36.096874 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.096881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.097431 (+ 550us) server_negotiation.cc:407] Connection header received
0811 07:08:36.097646 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.097653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.097760 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.097907 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.099629 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.100827 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.103099 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.103528 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.103630 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.107888 (+ 4258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.107897 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.107902 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.107947 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.111417 (+ 3470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.112483 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.112488 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.112491 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.112663 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.113075 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.113083 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.113085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.113495 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.113673 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.114368 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.114663 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":351,"threads_started":1}
I20260811 07:08:36.115634 24406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } attempt: 2
I20260811 07:08:36.117235 24583 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:08:36 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
Aug 11 07:08:36 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
Aug 11 07:08:36 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432115, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:08:36.134285 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.116179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:36990)
0811 07:08:36.116400 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:36.116419 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:36.116547 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:36.117004 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:36.117009 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:36.117574 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:36.117801 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.117812 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.119002 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.119007 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.120551 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.120564 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.121574 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.121582 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.121805 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.122499 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:36.122522 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:36.125905 (+ 3383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:36.130474 (+ 4569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.130482 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.130488 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.131475 (+ 987us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.131961 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.131969 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.131973 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.132187 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.133005 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:36.133012 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:36.133237 (+ 225us) client_negotiation.cc:769] Sending connection context
0811 07:08:36.133440 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 07:08:36.133794 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":28}
I20260811 07:08:36.135324 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.116460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36990 (local address 127.30.73.124:44967)
0811 07:08:36.116746 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.116751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.116764 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:08:36.116802 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.116805 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.116857 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.116959 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.118036 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.118861 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.120745 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.121420 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.121556 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.126148 (+ 4592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.126157 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.126162 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.126201 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.130288 (+ 4087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.131627 (+ 1339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.131634 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.131638 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.131809 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.132334 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.132363 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.132366 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.132870 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.133077 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.134657 (+ 1580us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.134935 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":178}
I20260811 07:08:36.135895 24589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.114077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49620 (local address 127.30.73.126:43283)
0811 07:08:36.114950 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.114956 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.114980 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:08:36.115030 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.115037 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.115128 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.116865 (+ 1737us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.117173 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.118452 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.119905 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.120516 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.120652 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.127173 (+ 6521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.127180 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.127184 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.127244 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.131523 (+ 4279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.132568 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.132574 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.132578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.132751 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.133257 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.133262 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.133265 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.133668 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.135041 (+ 1373us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.135194 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.135458 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":740,"thread_start_us":488,"threads_started":1}
I20260811 07:08:36.136106 24588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.118095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:35045 (local address 127.0.0.1:52402)
0811 07:08:36.119115 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:36.119134 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:36.119235 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:36.119590 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:36.119596 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:36.120066 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:36.120284 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.120296 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.121560 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.121568 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.123503 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.123525 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.124523 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.124530 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.124764 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.125443 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:36.125463 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:36.128301 (+ 2838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:36.132628 (+ 4327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.132635 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.132639 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.133345 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.133793 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.133798 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.133803 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.134001 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.135024 (+ 1023us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:36.135028 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:36.135172 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 07:08:36.135332 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 07:08:36.135689 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":906}
I20260811 07:08:36.136122 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.118130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52402 (local address 127.30.73.125:35045)
0811 07:08:36.118360 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.118366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.119227 (+ 861us) server_negotiation.cc:407] Connection header received
0811 07:08:36.119350 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.119356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.119436 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.119538 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.120464 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.121362 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.123733 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.124323 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.124494 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.128596 (+ 4102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.128601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.128605 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.128651 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.132489 (+ 3838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.133474 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.133480 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.133484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.133664 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.134155 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.134160 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.134162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.134771 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.134961 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.135445 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.135680 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:08:36.137547 24583 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:08:36.143168 24406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1: Bootstrap starting.
Aug 11 07:08:36 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432115, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
I20260811 07:08:36.147826 24406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:36.149164 24406 log.cc:824] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:36.153992 24406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1: No bootstrap required, opened a new log
I20260811 07:08:36.154877 24588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.138407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:37006)
0811 07:08:36.138640 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:36.138655 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:36.138733 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:36.139080 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:36.139084 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:36.139447 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:36.139586 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.139594 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.141144 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.141148 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.142150 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.142164 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.143634 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.143645 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.143920 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.144754 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:36.144784 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:36.147382 (+ 2598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:36.151771 (+ 4389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.151779 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.151785 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.152317 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.152746 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.152750 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.152754 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.152888 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.153608 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:36.153619 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:36.153807 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 07:08:36.154040 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 07:08:36.154428 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":26}
I20260811 07:08:36.154901 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.138447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37006 (local address 127.30.73.124:44967)
0811 07:08:36.138674 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.138681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.138713 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:08:36.138821 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.138826 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.138906 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.139021 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.139744 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.140963 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.142303 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.142965 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.143104 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.147632 (+ 4528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.147639 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.147643 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.147682 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.151461 (+ 3779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.152449 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.152454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.152458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.152599 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.153044 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.153048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.153051 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.153478 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.153660 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.154144 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.154552 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":182,"server-negotiator.queue_time_us":58}
Aug 11 07:08:36 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:08:36.161183 24583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94: Bootstrap starting.
I20260811 07:08:36.165514 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.143520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52404 (local address 127.30.73.125:35045)
0811 07:08:36.143718 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.143726 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.143750 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:08:36.143864 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.143869 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.143949 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.144061 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.145921 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.147347 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.149330 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.150127 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.150300 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.157417 (+ 7117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.157425 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.157431 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.157482 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.161336 (+ 3854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.162625 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.162632 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.162636 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.162863 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.163419 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.163426 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.163431 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.163865 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.164138 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.164812 (+ 674us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.165079 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:08:36.165319 24406 raft_consensus.cc:348] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } }
I20260811 07:08:36.166013 24406 raft_consensus.cc:729] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360006836afb4b70a3f43b70f0ea18f1, State: Initialized, Role: FOLLOWER
I20260811 07:08:36.166466 24583 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:36.166654 24406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } }
I20260811 07:08:36.167766 24592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.168125 24583 log.cc:824] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:36.168340 24592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:36.169229 24406 sys_catalog.cc:564] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:36.169960 24490 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } attempt: 5
I20260811 07:08:36.171823 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:36.172273 24583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94: No bootstrap required, opened a new log
I20260811 07:08:36.175712 24380 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "360006836afb4b70a3f43b70f0ea18f1"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49620
I20260811 07:08:36.176295 24380 raft_consensus.cc:482] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 07:08:36.176517 24380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 07:08:36 dist-test-slave-69rg krb5kdc[24314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432115, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
I20260811 07:08:36.180923 24380 raft_consensus.cc:504] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } }
W20260811 07:08:36.186180 24358 tablet.cc:2369] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:08:36.187304 24380 leader_election.cc:288] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [CANDIDATE]: Term 1 election: Requested vote from peers a907710de3894aafb04749bc8a92a5c4 (127.30.73.125:35045), aafd00cfb3f44b089d4eeb9dfe093c94 (127.30.73.124:44967)
I20260811 07:08:36.191483 24495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.170491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:44967 (local address 127.0.0.1:37018)
0811 07:08:36.170849 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:36.170870 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:36.170982 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:36.171912 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:36.171917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:36.172406 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:36.172606 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.172619 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.174230 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.174236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.175648 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:36.175667 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.177243 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.177251 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:36.177528 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.178288 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:36.178315 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:36.181553 (+ 3238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:36.187282 (+ 5729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.187290 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.187295 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.188120 (+ 825us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.188777 (+ 657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:36.188786 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:36.188789 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:36.189041 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:36.189952 (+ 911us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:36.189958 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:36.190169 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 07:08:36.190355 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 07:08:36.191019 (+ 664us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220}
I20260811 07:08:36.191969 24583 raft_consensus.cc:348] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } }
I20260811 07:08:36.192629 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.171219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37018 (local address 127.30.73.124:44967)
0811 07:08:36.171395 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.171401 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.171420 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:08:36.171486 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.171491 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.171600 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.171699 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.172802 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.174030 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.175843 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.176773 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.176935 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.181899 (+ 4964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.181909 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.181917 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.181981 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.187045 (+ 5064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.188327 (+ 1282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.188334 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.188337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.188528 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.189239 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.189245 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.189248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.189685 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.189875 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.191926 (+ 2051us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.192243 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:08:36.192687 24583 raft_consensus.cc:729] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aafd00cfb3f44b089d4eeb9dfe093c94, State: Initialized, Role: FOLLOWER
I20260811 07:08:36.193511 24583 consensus_queue.cc:260] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } }
I20260811 07:08:36.195093 24595 sys_catalog.cc:455] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.195503 24595 sys_catalog.cc:458] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:36.197180 24583 sys_catalog.cc:564] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:36.198112 24555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "360006836afb4b70a3f43b70f0ea18f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94"
I20260811 07:08:36.198925 24555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:36.202515 24490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4: Bootstrap starting.
I20260811 07:08:36.205127 24555 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360006836afb4b70a3f43b70f0ea18f1 in term 1.
I20260811 07:08:36.206555 24352 leader_election.cc:302] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360006836afb4b70a3f43b70f0ea18f1, aafd00cfb3f44b089d4eeb9dfe093c94; no voters:
I20260811 07:08:36.207243 24592 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:36.208058 24592 raft_consensus.cc:686] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [term 1 LEADER]: Becoming Leader. State: Replica: 360006836afb4b70a3f43b70f0ea18f1, State: Running, Role: LEADER
I20260811 07:08:36.208213 24490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:36.208712 24592 consensus_queue.cc:237] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } }
I20260811 07:08:36.209733 24490 log.cc:824] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:36.215277 24600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 360006836afb4b70a3f43b70f0ea18f1. Latest consensus state: current_term: 1 leader_uuid: "360006836afb4b70a3f43b70f0ea18f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.215938 24600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:36.218945 24607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:08:36.220854 24490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4: No bootstrap required, opened a new log
I20260811 07:08:36.233570 24607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:36.234088 24490 raft_consensus.cc:348] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } }
I20260811 07:08:36.234880 24490 raft_consensus.cc:729] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a907710de3894aafb04749bc8a92a5c4, State: Initialized, Role: FOLLOWER
I20260811 07:08:36.235687 24490 consensus_queue.cc:260] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } }
I20260811 07:08:36.243343 24614 sys_catalog.cc:455] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.246351 24459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "360006836afb4b70a3f43b70f0ea18f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a907710de3894aafb04749bc8a92a5c4"
I20260811 07:08:36.246241 24490 sys_catalog.cc:564] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:36.247135 24459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:36.253575 24459 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360006836afb4b70a3f43b70f0ea18f1 in term 1.
I20260811 07:08:36.246780 24614 sys_catalog.cc:458] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:36.277995 24555 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [term 1 FOLLOWER]: Refusing update from remote peer 360006836afb4b70a3f43b70f0ea18f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:08:36.279522 24459 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [term 1 FOLLOWER]: Refusing update from remote peer 360006836afb4b70a3f43b70f0ea18f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:08:36.279618 24600 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:08:36.281584 24600 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:08:36.296605 24531 tablet.cc:2369] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:08:36.317611 24641 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:08:36.318259 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.261187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37034 (local address 127.30.73.124:44967)
0811 07:08:36.261501 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.261511 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.262369 (+ 858us) server_negotiation.cc:407] Connection header received
0811 07:08:36.263586 (+ 1217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.263596 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.263732 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.263829 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.275719 (+ 11890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.277365 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.295171 (+ 17806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.295914 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.296043 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.302961 (+ 6918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.302973 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.302980 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.303048 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.308090 (+ 5042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.315160 (+ 7070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.315167 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.315171 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.315399 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.315966 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.315971 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.315974 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.316465 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.316752 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.317493 (+ 741us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.317791 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 07:08:36.274048 24500 master_runner.cc:186] Error getting master registration for 127.30.73.126:43283: OK, instance_id { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" instance_seqno: 1786432114697149 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:08:36.322898 24595 sys_catalog.cc:455] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 360006836afb4b70a3f43b70f0ea18f1. Latest consensus state: current_term: 1 leader_uuid: "360006836afb4b70a3f43b70f0ea18f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.333582 24595 sys_catalog.cc:458] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:36.334740 24500 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 07:08:36.345471 24632 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 07:08:36.345989 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.261217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52410 (local address 127.30.73.125:35045)
0811 07:08:36.261731 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.261741 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.273660 (+ 11919us) server_negotiation.cc:407] Connection header received
0811 07:08:36.274013 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.274022 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.274173 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.274255 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.291066 (+ 16811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.292950 (+ 1884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.297069 (+ 4119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.297973 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.298134 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.319932 (+ 21798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.319940 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.319944 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.319992 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.340184 (+ 20192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.341454 (+ 1270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.341461 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.341465 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.341670 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.342209 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.342214 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.342217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.343031 (+ 814us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.343561 (+ 530us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.345154 (+ 1593us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.345491 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327}
I20260811 07:08:36.347520 24614 sys_catalog.cc:455] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 360006836afb4b70a3f43b70f0ea18f1. Latest consensus state: current_term: 1 leader_uuid: "360006836afb4b70a3f43b70f0ea18f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.348007 24614 sys_catalog.cc:458] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:08:36.353933 24632 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:08:36.357060 24607 catalog_manager.cc:1347] Generated new cluster ID: e14ca4aca0034ba3b314ace00caf12a0
I20260811 07:08:36.357203 24607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:36.364590 24614 sys_catalog.cc:455] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "360006836afb4b70a3f43b70f0ea18f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.365116 24614 sys_catalog.cc:458] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:36.370230 24595 sys_catalog.cc:455] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "360006836afb4b70a3f43b70f0ea18f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.370617 24595 sys_catalog.cc:458] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:36.329109 24330 master_runner.cc:186] Error getting master registration for 127.30.73.125:35045: OK, instance_id { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" instance_seqno: 1786432115412479 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:08:36.377130 24330 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:08:36.385113 24600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "360006836afb4b70a3f43b70f0ea18f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.385242 24592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "360006836afb4b70a3f43b70f0ea18f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360006836afb4b70a3f43b70f0ea18f1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 43283 } } peers { permanent_uuid: "a907710de3894aafb04749bc8a92a5c4" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 35045 } } peers { permanent_uuid: "aafd00cfb3f44b089d4eeb9dfe093c94" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 44967 } } }
I20260811 07:08:36.385463 24600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:36.385501 24592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:36.398666 24589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:36.262579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49630 (local address 127.30.73.126:43283)
0811 07:08:36.262813 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.262822 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.320854 (+ 58032us) server_negotiation.cc:407] Connection header received
0811 07:08:36.321953 (+ 1099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.321959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.322077 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.322176 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.332040 (+ 9864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.333375 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.335747 (+ 2372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:36.348862 (+ 13115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:36.349045 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:36.375818 (+ 26773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:36.375832 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:36.375840 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:36.375913 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:36.381664 (+ 5751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.385912 (+ 4248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.385921 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.385926 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.386153 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:36.390462 (+ 4309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:36.390470 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:36.390475 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:36.391092 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:36.391483 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:36.397878 (+ 6395us) server_negotiation.cc:299] Negotiation successful
0811 07:08:36.398257 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 07:08:36.400419 24660 catalog_manager.cc:1259] Loaded cluster ID: e14ca4aca0034ba3b314ace00caf12a0
I20260811 07:08:36.400548 24660 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4: loading cluster ID for follower catalog manager: success
W20260811 07:08:36.401983 24660 catalog_manager.cc:1576] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260811 07:08:36.402153 24660 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:08:36.430477 24607 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:36.432842 24607 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:36.468427 24607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 360006836afb4b70a3f43b70f0ea18f1: Generated new TSK 0
I20260811 07:08:36.469708 24607 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:08:36.659407 24589 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:36.636518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49644 (local address 127.30.73.126:43283)
0811 07:08:36.636966 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.636974 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.655356 (+ 18382us) server_negotiation.cc:407] Connection header received
0811 07:08:36.655607 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.655617 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.655727 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.655863 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.659095 (+ 3232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49644: BlockingRecv error: recv got EOF from 127.0.0.1:49644 (error 108)
Metrics: {"server-negotiator.queue_time_us":292}
W20260811 07:08:36.667863 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:36.637159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.30.73.125:35045)
0811 07:08:36.637383 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.637390 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.662867 (+ 25477us) server_negotiation.cc:407] Connection header received
0811 07:08:36.664448 (+ 1581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.664456 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.664553 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.664695 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.667577 (+ 2882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52412: BlockingRecv error: recv got EOF from 127.0.0.1:52412 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 07:08:36.671368 24586 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:36.642167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37042 (local address 127.30.73.124:44967)
0811 07:08:36.642412 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.642419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.666411 (+ 23992us) server_negotiation.cc:407] Connection header received
0811 07:08:36.669121 (+ 2710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.669129 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.669283 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.669399 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.671070 (+ 1671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37042: BlockingRecv error: recv got EOF from 127.0.0.1:37042 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
W20260811 07:08:36.713294 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:36.702035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52416 (local address 127.30.73.125:35045)
0811 07:08:36.702279 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.702286 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.711022 (+ 8736us) server_negotiation.cc:407] Connection header received
0811 07:08:36.711384 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.711391 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.711532 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.711608 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.712953 (+ 1345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52416: BlockingRecv error: recv got EOF from 127.0.0.1:52416 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260811 07:08:36.773649 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:36.762478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52422 (local address 127.30.73.125:35045)
0811 07:08:36.762754 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.762764 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.771436 (+ 8672us) server_negotiation.cc:407] Connection header received
0811 07:08:36.772029 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.772037 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.772162 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.772242 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.773401 (+ 1159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52422: BlockingRecv error: recv got EOF from 127.0.0.1:52422 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260811 07:08:36.832229 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:36.818471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52426 (local address 127.30.73.125:35045)
0811 07:08:36.818680 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.818687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.829924 (+ 11237us) server_negotiation.cc:407] Connection header received
0811 07:08:36.830550 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.830557 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.830682 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.830765 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.831931 (+ 1166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52426: BlockingRecv error: recv got EOF from 127.0.0.1:52426 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 07:08:36.887413 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:36.871672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52442 (local address 127.30.73.125:35045)
0811 07:08:36.871899 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.871909 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.884362 (+ 12453us) server_negotiation.cc:407] Connection header received
0811 07:08:36.885631 (+ 1269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.885638 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.885762 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.885886 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.887129 (+ 1243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52442: BlockingRecv error: recv got EOF from 127.0.0.1:52442 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260811 07:08:36.957574 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:36.942587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52452 (local address 127.30.73.125:35045)
0811 07:08:36.942807 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.942814 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.955052 (+ 12238us) server_negotiation.cc:407] Connection header received
0811 07:08:36.955775 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.955789 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.955903 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.955993 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.957241 (+ 1248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52452: BlockingRecv error: recv got EOF from 127.0.0.1:52452 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 07:08:36.999547 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:36.978539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52462 (local address 127.30.73.125:35045)
0811 07:08:36.978768 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:36.978777 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:36.986613 (+ 7836us) server_negotiation.cc:407] Connection header received
0811 07:08:36.986851 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:36.986858 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:36.986986 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:36.987128 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:36.999184 (+ 12056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52462: BlockingRecv error: recv got EOF from 127.0.0.1:52462 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260811 07:08:37.092202 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:37.073303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52466 (local address 127.30.73.125:35045)
0811 07:08:37.073517 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:37.073524 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:37.090599 (+ 17075us) server_negotiation.cc:407] Connection header received
0811 07:08:37.090855 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:37.090859 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:37.090940 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:37.091054 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:37.091884 (+ 830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52466: BlockingRecv error: recv got EOF from 127.0.0.1:52466 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 07:08:37.162761 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:37.160463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52480 (local address 127.30.73.125:35045)
0811 07:08:37.160785 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:37.160792 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:37.161027 (+ 235us) server_negotiation.cc:407] Connection header received
0811 07:08:37.161221 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:37.161226 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:37.161347 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:37.161443 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:37.162529 (+ 1086us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52480: BlockingRecv error: recv got EOF from 127.0.0.1:52480 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
W20260811 07:08:37.297297 24496 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:37.294999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52494 (local address 127.30.73.125:35045)
0811 07:08:37.295259 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:37.295268 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:37.295589 (+ 321us) server_negotiation.cc:407] Connection header received
0811 07:08:37.295849 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:37.295854 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:37.295931 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:37.296045 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:37.297005 (+ 960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52494: BlockingRecv error: recv got EOF from 127.0.0.1:52494 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 07:08:37.356518 24632 catalog_manager.cc:1259] Loaded cluster ID: e14ca4aca0034ba3b314ace00caf12a0
I20260811 07:08:37.356629 24632 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94: loading cluster ID for follower catalog manager: success
I20260811 07:08:37.359361 24632 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94: acquiring CA information for follower catalog manager: success
I20260811 07:08:37.361253 24632 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aafd00cfb3f44b089d4eeb9dfe093c94: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:08:37.405557 24660 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4: acquiring CA information for follower catalog manager: success
I20260811 07:08:37.407694 24660 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a907710de3894aafb04749bc8a92a5c4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:08:37.569940 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:37.560508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52506 (local address 127.30.73.125:35045)
0811 07:08:37.560726 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:37.560731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:37.561214 (+ 483us) server_negotiation.cc:407] Connection header received
0811 07:08:37.561422 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:37.561431 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:37.561736 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:37.561942 (+ 206us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:37.562415 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.563972 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.565993 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.566970 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.567154 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:37.567881 (+ 727us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:37.568899 (+ 1018us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:37.569133 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:37.569278 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 07:08:37.569418 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:08:37.595592 24734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:37.578368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37050 (local address 127.30.73.124:44967)
0811 07:08:37.588461 (+ 10093us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:37.588471 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:37.588504 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:08:37.588684 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:37.588690 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:37.588993 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:37.589224 (+ 231us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:37.590044 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.591308 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.592837 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.593296 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.593444 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:37.594088 (+ 644us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:37.594840 (+ 752us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:37.595049 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:37.595106 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 07:08:37.595207 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9912,"thread_start_us":9757,"threads_started":1}
I20260811 07:08:37.612583 24734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:37.603570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37064 (local address 127.30.73.124:44967)
0811 07:08:37.603770 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:37.603776 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:37.604351 (+ 575us) server_negotiation.cc:407] Connection header received
0811 07:08:37.604649 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:37.604659 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:37.604791 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:37.604931 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:37.605673 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.607290 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.609785 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.610566 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.610704 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:37.611680 (+ 976us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:37.611818 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:37.611873 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:37.612097 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 07:08:37.612192 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:08:37.619612 24740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:37.603862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49650 (local address 127.30.73.126:43283)
0811 07:08:37.608407 (+ 4545us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:37.608416 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:37.609022 (+ 606us) server_negotiation.cc:407] Connection header received
0811 07:08:37.609338 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:37.609348 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:37.609633 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:37.609913 (+ 280us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:37.611630 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.613445 (+ 1815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.615737 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.616615 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.616783 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:37.617752 (+ 969us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:37.618488 (+ 736us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:37.618608 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:37.619129 (+ 521us) server_negotiation.cc:299] Negotiation successful
0811 07:08:37.619247 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4376,"thread_start_us":4255,"threads_started":1}
I20260811 07:08:37.619755 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:37.603453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52510 (local address 127.30.73.125:35045)
0811 07:08:37.603721 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:37.603733 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:37.610556 (+ 6823us) server_negotiation.cc:407] Connection header received
0811 07:08:37.610733 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:37.610743 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:37.610878 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:37.610981 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:37.612990 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.614150 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.617216 (+ 3066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:37.617996 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:37.618115 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:37.618776 (+ 661us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:37.618893 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:37.619027 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:37.619315 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 07:08:37.619411 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:08:37.633250 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24330
I20260811 07:08:37.634905 24401 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:37.770440 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 24330
I20260811 07:08:37.801366 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24414
I20260811 07:08:37.802958 24485 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:37.929610 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 24414
I20260811 07:08:37.960405 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24500
I20260811 07:08:37.961966 24578 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:38.092197 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 24500
2026-08-11T07:08:38Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5632 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:08:38 dist-test-slave-69rg krb5kdc[24748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:08:38 dist-test-slave-69rg krb5kdc[24748](info): set up 2 sockets
Aug 11 07:08:38 dist-test-slave-69rg krb5kdc[24748](info): commencing operation
krb5kdc: starting...
W20260811 07:08:39.391997 31013 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.005s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/test-user.keytab.
Aug 11 07:08:39 dist-test-slave-69rg krb5kdc[24748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:08:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:08:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.73.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
Entry for principal kudu/127.30.73.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab.
I20260811 07:08:39.750432 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:42951
--webserver_interface=127.30.73.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:42951,127.30.73.125:40509,127.30.73.124:45919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:08:40.113610 24762 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:08:40.114030 24762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:40.114148 24762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:40.114274 24762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:40.121728 24762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:40.121888 24762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:40.122004 24762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:40.122109 24762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:40.122223 24762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:40.132457 24762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:42951,127.30.73.125:40509,127.30.73.124:45919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.126.keytab
--principal=kudu/127.30.73.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.126:42951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.73.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:40.133945 24762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:40.135390 24762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:40.147562 24767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:40.147826 24770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:40.147926 24768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:40.148800 24762 server_base.cc:1034] running on GCE node
I20260811 07:08:40.149569 24762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:40.151063 24762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:40.152356 24762 hybrid_clock.cc:648] HybridClock initialized: now 1786432120152284 us; error 33 us; skew 500 ppm
I20260811 07:08:40.152763 24762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:40 dist-test-slave-69rg krb5kdc[24748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:40.156152 24762 init.cc:377] Logged in from keytab as kudu/127.30.73.126@KRBTEST.COM (short username kudu)
I20260811 07:08:40.157917 24762 webserver.cc:460] Webserver started at http://127.30.73.126:39599/ using document root <none> and password file <none>
I20260811 07:08:40.158676 24762 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:40.158821 24762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:40.159170 24762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:40.162395 24762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/data/instance:
uuid: "87f844927c1240c1bcdeb716d141a1e1"
format_stamp: "Formatted at 2026-08-11 07:08:40 on dist-test-slave-69rg"
server_key: "5f10f174594bf036ecafb63356c3fa52"
server_key_iv: "2221ae94fb488dce817a97a082f5f508"
server_key_version: "encryptionkey@0"
I20260811 07:08:40.163264 24762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/wal/instance:
uuid: "87f844927c1240c1bcdeb716d141a1e1"
format_stamp: "Formatted at 2026-08-11 07:08:40 on dist-test-slave-69rg"
server_key: "5f10f174594bf036ecafb63356c3fa52"
server_key_iv: "2221ae94fb488dce817a97a082f5f508"
server_key_version: "encryptionkey@0"
I20260811 07:08:40.168744 24762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:08:40.172600 24779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:40.174152 24762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:08:40.174368 24762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/wal
uuid: "87f844927c1240c1bcdeb716d141a1e1"
format_stamp: "Formatted at 2026-08-11 07:08:40 on dist-test-slave-69rg"
server_key: "5f10f174594bf036ecafb63356c3fa52"
server_key_iv: "2221ae94fb488dce817a97a082f5f508"
server_key_version: "encryptionkey@0"
I20260811 07:08:40.174608 24762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:40.192646 24762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:40.197305 24762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:40.197640 24762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:40.218091 24762 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.126:42951
I20260811 07:08:40.218050 24838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.126:42951 every 8 connection(s)
I20260811 07:08:40.219707 24762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/data/info.pb
I20260811 07:08:40.223948 24839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:40.225018 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 24762
I20260811 07:08:40.225235 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-0/wal/instance
I20260811 07:08:40.225883 31013 external_mini_cluster.cc:1428] Setting key 753adb5e7361da1cc6859c197ce9d078
I20260811 07:08:40.234504 24839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:08:40 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.73.125@KRBTEST.COM; defaulting to no policy
I20260811 07:08:40.262538 24844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.238961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33782 (local address 127.30.73.126:42951)
0811 07:08:40.240948 (+ 1987us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:40.240954 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:40.241000 (+ 46us) server_negotiation.cc:407] Connection header received
0811 07:08:40.242677 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:40.242687 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:40.243019 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:40.243232 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:40.244696 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.246744 (+ 2048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.248342 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.249319 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.249519 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:40.253482 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:40.253497 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:40.253518 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:40.253567 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:40.257721 (+ 4154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:40.258736 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:40.258743 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:40.258745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:40.258897 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:40.259326 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:40.259331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:40.259334 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:40.259866 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:40.260086 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:40.260655 (+ 569us) server_negotiation.cc:299] Negotiation successful
0811 07:08:40.260973 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1789,"spinlock_wait_cycles":37504,"thread_start_us":1533,"threads_started":1}
I20260811 07:08:40.262558 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.238961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:42951 (local address 127.0.0.1:33782)
0811 07:08:40.239957 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.240009 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:40.242303 (+ 2294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:40.243363 (+ 1060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:40.243372 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:40.244081 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:40.244449 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:40.244467 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.246939 (+ 2472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.246943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:40.248179 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:40.248193 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.249551 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.249557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:40.249680 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:40.250498 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:40.250522 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:40.253195 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:40.257899 (+ 4704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:40.257915 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:40.257932 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:40.258587 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:40.259020 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:40.259027 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:40.259032 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:40.259205 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:40.260002 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:40.260011 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:40.260242 (+ 231us) client_negotiation.cc:769] Sending connection context
0811 07:08:40.260497 (+ 255us) client_negotiation.cc:240] Negotiation successful
0811 07:08:40.261172 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":153,"thread_start_us":406,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.125@KRBTEST.COM" created.
I20260811 07:08:40.265849 24839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:08:40.267158 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.266701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:55996)
0811 07:08:40.266899 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.267032 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260811 07:08:40.267470 24782 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
I20260811 07:08:40.269176 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.268778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56002)
0811 07:08:40.268975 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.269043 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 07:08:40.269395 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40509: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab.
Entry for principal kudu/127.30.73.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab.
I20260811 07:08:40.307228 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.125:40509
--webserver_interface=127.30.73.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab
--principal=kudu/127.30.73.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:42951,127.30.73.125:40509,127.30.73.124:45919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:08:40.318773 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } attempt: 1
I20260811 07:08:40.320132 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.319567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56016)
0811 07:08:40.319782 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.319922 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 07:08:40.321408 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.320912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56020)
0811 07:08:40.321102 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.321210 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 07:08:40.321653 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40509: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
I20260811 07:08:40.389958 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } attempt: 2
I20260811 07:08:40.391422 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.390752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56030)
0811 07:08:40.391084 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.391221 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 07:08:40.392617 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.392150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56038)
0811 07:08:40.392329 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.392435 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260811 07:08:40.392882 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40509: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
I20260811 07:08:40.484189 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } attempt: 3
I20260811 07:08:40.485464 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.484917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56052)
0811 07:08:40.485171 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.485288 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 07:08:40.486703 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.486247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56062)
0811 07:08:40.486418 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.486510 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 07:08:40.486956 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40509: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
I20260811 07:08:40.630282 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } attempt: 4
I20260811 07:08:40.632019 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.631218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56076)
0811 07:08:40.631641 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.631786 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212}
I20260811 07:08:40.633356 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.632856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56086)
0811 07:08:40.633049 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.633164 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 07:08:40.633641 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.125:40509: Network error: Client connection negotiation failed: client connection to 127.30.73.125:40509: connect: Connection refused (error 111)
W20260811 07:08:40.672519 24850 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:08:40.672969 24850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:40.673048 24850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:40.673144 24850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:40.681631 24850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:40.681768 24850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:40.681896 24850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:40.681968 24850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:40.682045 24850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:40.693420 24850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:42951,127.30.73.125:40509,127.30.73.124:45919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.125.keytab
--principal=kudu/127.30.73.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.125:40509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.73.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:40.695235 24850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:40.696889 24850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:08:40.711612 24857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:40.711668 24858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:40.711668 24860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:40.713270 24850 server_base.cc:1034] running on GCE node
I20260811 07:08:40.714527 24850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:40.716487 24850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:40.717793 24850 hybrid_clock.cc:648] HybridClock initialized: now 1786432120717710 us; error 38 us; skew 500 ppm
I20260811 07:08:40.718353 24850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:40 dist-test-slave-69rg krb5kdc[24748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:40.722481 24850 init.cc:377] Logged in from keytab as kudu/127.30.73.125@KRBTEST.COM (short username kudu)
I20260811 07:08:40.724530 24850 webserver.cc:460] Webserver started at http://127.30.73.125:43927/ using document root <none> and password file <none>
I20260811 07:08:40.725616 24850 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:40.725769 24850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:40.726236 24850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:40.730094 24850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/data/instance:
uuid: "995e9e102f4d4776874050d86f059f1a"
format_stamp: "Formatted at 2026-08-11 07:08:40 on dist-test-slave-69rg"
server_key: "9c539adf7fc35deab1808f4d6af1df32"
server_key_iv: "2c0df626afd1e746d5d34609114aaa0d"
server_key_version: "encryptionkey@0"
I20260811 07:08:40.731101 24850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/wal/instance:
uuid: "995e9e102f4d4776874050d86f059f1a"
format_stamp: "Formatted at 2026-08-11 07:08:40 on dist-test-slave-69rg"
server_key: "9c539adf7fc35deab1808f4d6af1df32"
server_key_iv: "2c0df626afd1e746d5d34609114aaa0d"
server_key_version: "encryptionkey@0"
I20260811 07:08:40.737871 24850 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 07:08:40.742507 24868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:40.744650 24850 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:08:40.744876 24850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/wal
uuid: "995e9e102f4d4776874050d86f059f1a"
format_stamp: "Formatted at 2026-08-11 07:08:40 on dist-test-slave-69rg"
server_key: "9c539adf7fc35deab1808f4d6af1df32"
server_key_iv: "2c0df626afd1e746d5d34609114aaa0d"
server_key_version: "encryptionkey@0"
I20260811 07:08:40.745146 24850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:40.769505 24850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:40.775815 24850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:40.776153 24850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:40.800078 24850 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.125:40509
I20260811 07:08:40.800094 24922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.125:40509 every 8 connection(s)
I20260811 07:08:40.802129 24850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/data/info.pb
I20260811 07:08:40.804911 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 24850
I20260811 07:08:40.805154 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-1/wal/instance
I20260811 07:08:40.805805 31013 external_mini_cluster.cc:1428] Setting key b679b0f555e977c09baaa56740dbf518
I20260811 07:08:40.807935 24923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:40.819837 24923 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:08:40 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:08:40.847627 24925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.824046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33794 (local address 127.30.73.126:42951)
0811 07:08:40.824678 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:40.824683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:40.826196 (+ 1513us) server_negotiation.cc:407] Connection header received
0811 07:08:40.829263 (+ 3067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:40.829270 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:40.829386 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:40.829538 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:40.831533 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.832331 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.834133 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.834782 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.834981 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:40.839766 (+ 4785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:40.839773 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:40.839777 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:40.839839 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:40.843586 (+ 3747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:40.844634 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:40.844639 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:40.844642 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:40.844795 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:40.845303 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:40.845307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:40.845309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:40.845698 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:40.845936 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:40.846863 (+ 927us) server_negotiation.cc:299] Negotiation successful
0811 07:08:40.847151 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":355,"threads_started":1}
I20260811 07:08:40.848951 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.824847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:42951 (local address 127.0.0.1:33794)
0811 07:08:40.825991 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.826046 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:40.828887 (+ 2841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:40.829898 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:40.829915 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:40.830572 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:40.831269 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:40.831288 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.832522 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.832530 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:40.833968 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:40.833982 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.835093 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.835101 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:40.835431 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:40.836370 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:40.836407 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:40.839296 (+ 2889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:40.843805 (+ 4509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:40.843819 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:40.843851 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:40.844458 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:40.844932 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:40.844938 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:40.844941 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:40.845159 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:40.845910 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:40.845919 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:40.846419 (+ 500us) client_negotiation.cc:769] Sending connection context
0811 07:08:40.846742 (+ 323us) client_negotiation.cc:240] Negotiation successful
0811 07:08:40.847488 (+ 746us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":454,"threads_started":1}
WARNING: no policy specified for kudu/127.30.73.124@KRBTEST.COM; defaulting to no policy
I20260811 07:08:40.851514 24923 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.73.124@KRBTEST.COM" created.
Aug 11 07:08:40 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:08:40.870399 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.852711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56088)
0811 07:08:40.852959 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.852983 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:40.853126 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:40.854293 (+ 1167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:40.854305 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:40.854925 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:40.855170 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:40.855187 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.856824 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.856833 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:40.858412 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:40.858431 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.859475 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.859484 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:40.859721 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:40.860531 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:40.860559 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:40.863590 (+ 3031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:40.867473 (+ 3883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:40.867478 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:40.867483 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:40.867902 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:40.868341 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:40.868346 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:40.868350 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:40.868490 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:40.869195 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:40.869199 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:40.869379 (+ 180us) client_negotiation.cc:769] Sending connection context
0811 07:08:40.869545 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 07:08:40.869924 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 07:08:40.870460 24928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.852833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56088 (local address 127.30.73.125:40509)
0811 07:08:40.853704 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:40.853711 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:40.853742 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:08:40.853792 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:40.853798 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:40.854104 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:40.854243 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:40.855409 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.856661 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.858599 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.859287 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.859443 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:40.863856 (+ 4413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:40.863874 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:40.863896 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:40.863930 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:40.867270 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:40.868051 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:40.868068 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:40.868070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:40.868200 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:40.868610 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:40.868616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:40.868619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:40.869057 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:40.869319 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:40.869704 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 07:08:40.870057 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":687,"thread_start_us":525,"threads_started":1}
I20260811 07:08:40.873958 24923 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:08:40.875586 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.874858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60024)
0811 07:08:40.875124 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.875312 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260811 07:08:40.875937 24870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
I20260811 07:08:40.878126 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.877490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60040)
0811 07:08:40.877735 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.877892 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 07:08:40.878574 24923 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.73.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab.
Entry for principal kudu/127.30.73.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab.
I20260811 07:08:40.906320 31013 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
/tmp/dist-test-taskgm9MY0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.124:45919
--webserver_interface=127.30.73.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab
--principal=kudu/127.30.73.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.73.84:36359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.73.126:42951,127.30.73.125:40509,127.30.73.124:45919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:08:40.928045 24923 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 1
I20260811 07:08:40.929746 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.928977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60042)
0811 07:08:40.929296 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.929476 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260811 07:08:40.931164 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.930627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60048)
0811 07:08:40.930854 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.930974 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 07:08:40.931506 24923 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
I20260811 07:08:40.932924 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } attempt: 5
Aug 11 07:08:40 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:08:40.948979 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.933772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56104)
0811 07:08:40.934062 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.934086 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:40.934292 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:40.934916 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:40.934923 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:40.935457 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:40.935687 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:40.935699 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.936814 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.936827 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:40.937771 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:40.937785 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.938665 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.938671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:40.938931 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:40.939687 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:40.939708 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:40.942350 (+ 2642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:40.946001 (+ 3651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:40.946010 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:40.946016 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:40.946490 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:40.946945 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:40.946950 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:40.946954 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:40.947149 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:40.947792 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:40.947797 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:40.947997 (+ 200us) client_negotiation.cc:769] Sending connection context
0811 07:08:40.948159 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 07:08:40.948569 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126}
I20260811 07:08:40.949008 24928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.933803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56104 (local address 127.30.73.125:40509)
0811 07:08:40.934060 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:40.934067 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:40.934186 (+ 119us) server_negotiation.cc:407] Connection header received
0811 07:08:40.934442 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:40.934448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:40.934701 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:40.934866 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:40.935851 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.936655 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.937977 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:40.938484 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:40.938641 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:40.942629 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:40.942635 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:40.942639 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:40.942681 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:40.945748 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:40.946651 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:40.946663 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:40.946666 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:40.946812 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:40.947280 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:40.947284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:40.947286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:40.947657 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:40.947836 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:40.948294 (+ 458us) server_negotiation.cc:299] Negotiation successful
0811 07:08:40.948595 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260811 07:08:40.950781 24839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:08:40.952195 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.951689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60060)
0811 07:08:40.951911 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.952019 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 07:08:40.953365 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:40.952971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60074)
0811 07:08:40.953146 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:40.953250 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260811 07:08:40.953649 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
I20260811 07:08:40.999817 24923 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 2
I20260811 07:08:41.001565 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.000871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60076)
0811 07:08:41.001174 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.001315 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 07:08:41.002960 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.002441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60092)
0811 07:08:41.002619 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.002726 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 07:08:41.003286 24923 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
I20260811 07:08:41.004918 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 1
I20260811 07:08:41.006276 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.005724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60096)
0811 07:08:41.005961 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.006073 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 07:08:41.007522 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.007113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60110)
0811 07:08:41.007310 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.007390 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 07:08:41.007795 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
I20260811 07:08:41.076093 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 2
I20260811 07:08:41.077761 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.077083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60124)
0811 07:08:41.077393 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.077512 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 07:08:41.080016 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.079507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60134)
0811 07:08:41.079708 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.079828 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 07:08:41.080266 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
I20260811 07:08:41.094596 24923 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 3
I20260811 07:08:41.096431 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.095625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60142)
0811 07:08:41.095953 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.096113 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 07:08:41.098176 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.097382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60158)
0811 07:08:41.097752 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.097927 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217}
W20260811 07:08:41.098496 24923 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
I20260811 07:08:41.186549 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 3
I20260811 07:08:41.188247 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.187603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60172)
0811 07:08:41.187883 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.188020 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260811 07:08:41.189688 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.189185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60184)
0811 07:08:41.189431 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.189543 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260811 07:08:41.190011 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
I20260811 07:08:41.241750 24923 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 4
I20260811 07:08:41.243494 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.242779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60196)
0811 07:08:41.243073 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.243224 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 07:08:41.245095 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.244560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60200)
0811 07:08:41.244761 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.244907 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 07:08:41.245304 24923 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
W20260811 07:08:41.335476 24932 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:08:41.335939 24932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:08:41.336076 24932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:08:41.336217 24932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:08:41.344512 24932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:08:41.344655 24932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:08:41.344769 24932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:08:41.344834 24932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:08:41.344913 24932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:08:41.356773 24932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.73.84:36359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.73.126:42951,127.30.73.125:40509,127.30.73.124:45919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/krb5kdc/kudu_127.30.73.124.keytab
--principal=kudu/127.30.73.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.73.124:45919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.73.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 07:08:41.358752 24932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:08:41.360414 24932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:08:41.367316 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 4
I20260811 07:08:41.369074 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.368437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60204)
0811 07:08:41.368791 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.368892 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199}
I20260811 07:08:41.370530 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.370037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60214)
0811 07:08:41.370240 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.370349 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260811 07:08:41.370909 24839 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.73.124:45919: Network error: Client connection negotiation failed: client connection to 127.30.73.124:45919: connect: Connection refused (error 111)
W20260811 07:08:41.377069 24940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:41.377156 24943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:08:41.377197 24939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:08:41.378512 24932 server_base.cc:1034] running on GCE node
I20260811 07:08:41.379809 24932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:08:41.381999 24932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:08:41.383285 24932 hybrid_clock.cc:648] HybridClock initialized: now 1786432121383219 us; error 43 us; skew 500 ppm
I20260811 07:08:41.383769 24932 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 07:08:41 dist-test-slave-69rg krb5kdc[24748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432121, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:08:41.388007 24932 init.cc:377] Logged in from keytab as kudu/127.30.73.124@KRBTEST.COM (short username kudu)
I20260811 07:08:41.390027 24932 webserver.cc:460] Webserver started at http://127.30.73.124:36299/ using document root <none> and password file <none>
I20260811 07:08:41.390956 24932 fs_manager.cc:359] Metadata directory not provided
I20260811 07:08:41.391067 24932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:08:41.391436 24932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:08:41.395660 24932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/data/instance:
uuid: "0ab9e15dba0b4d22a561137d7c31649c"
format_stamp: "Formatted at 2026-08-11 07:08:41 on dist-test-slave-69rg"
server_key: "46635381b3ec960e37d3feef7a2ef9b0"
server_key_iv: "425072f01f1cb0e9dffbf2cc9c268af9"
server_key_version: "encryptionkey@0"
I20260811 07:08:41.396802 24932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/wal/instance:
uuid: "0ab9e15dba0b4d22a561137d7c31649c"
format_stamp: "Formatted at 2026-08-11 07:08:41 on dist-test-slave-69rg"
server_key: "46635381b3ec960e37d3feef7a2ef9b0"
server_key_iv: "425072f01f1cb0e9dffbf2cc9c268af9"
server_key_version: "encryptionkey@0"
I20260811 07:08:41.404131 24932 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260811 07:08:41.409170 24952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:08:41.411201 24932 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:08:41.411520 24932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/data,/tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/wal
uuid: "0ab9e15dba0b4d22a561137d7c31649c"
format_stamp: "Formatted at 2026-08-11 07:08:41 on dist-test-slave-69rg"
server_key: "46635381b3ec960e37d3feef7a2ef9b0"
server_key_iv: "425072f01f1cb0e9dffbf2cc9c268af9"
server_key_version: "encryptionkey@0"
I20260811 07:08:41.411898 24932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:08:41.467530 24932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:08:41.473505 24932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:08:41.473927 24932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:08:41.499514 24932 rpc_server.cc:307] RPC server started. Bound to: 127.30.73.124:45919
I20260811 07:08:41.499491 25008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.73.124:45919 every 8 connection(s)
I20260811 07:08:41.501446 24932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/data/info.pb
I20260811 07:08:41.504371 31013 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu as pid 24932
I20260811 07:08:41.504614 31013 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgm9MY0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786431722204153-31013-0/minicluster-data/master-2/wal/instance
I20260811 07:08:41.505311 31013 external_mini_cluster.cc:1428] Setting key 6c4979ab99c6bc241df9d4c55004d39a
I20260811 07:08:41.507229 25009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:08:41.519605 25009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:08:41 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
Aug 11 07:08:41 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432121, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
I20260811 07:08:41.535774 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.507763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60218 (local address 127.30.73.124:45919)
0811 07:08:41.508742 (+ 979us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.508761 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.508824 (+ 63us) server_negotiation.cc:407] Connection header received
0811 07:08:41.511231 (+ 2407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.511267 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.511957 (+ 690us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.512599 (+ 642us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.514292 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.516785 (+ 2493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.518607 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.519772 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.520004 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.525725 (+ 5721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.525764 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.525785 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.525868 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.530429 (+ 4561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.531417 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.531425 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.531433 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.531634 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.532144 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.532153 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.532157 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.533051 (+ 894us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.533458 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.533849 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.534399 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":396,"threads_started":1}
I20260811 07:08:41.542687 25014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.523734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.126:42951 (local address 127.0.0.1:33810)
0811 07:08:41.525060 (+ 1326us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.525115 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:41.525351 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:41.525901 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:41.525910 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:41.527060 (+ 1150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:41.527611 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.527628 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.529051 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.529058 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.530871 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.530883 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.531835 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.531840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.531985 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.532649 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:41.532670 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:41.535532 (+ 2862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:41.539633 (+ 4101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.539643 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.539650 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.540270 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.540688 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.540693 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.540697 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.540855 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.541391 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:41.541399 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:41.541606 (+ 207us) client_negotiation.cc:769] Sending connection context
0811 07:08:41.541792 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 07:08:41.542193 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":995,"thread_start_us":788,"threads_started":1}
I20260811 07:08:41.542738 25013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.523703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33810 (local address 127.30.73.126:42951)
0811 07:08:41.524501 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.524508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.525264 (+ 756us) server_negotiation.cc:407] Connection header received
0811 07:08:41.525533 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.525539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.525666 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.525766 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.527804 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.528857 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.531052 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.531624 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.531756 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.535752 (+ 3996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.535758 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.535761 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.535803 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.539373 (+ 3570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.540406 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.540418 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.540420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.540570 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.540985 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.540988 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.540991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.541257 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.541440 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.541975 (+ 535us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.542231 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":417,"threads_started":1}
I20260811 07:08:41.544318 25009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:08:41.544564 24923 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 5
Aug 11 07:08:41 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.126@KRBTEST.COM
Aug 11 07:08:41 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.125@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
Aug 11 07:08:41 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432121, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:08:41.559422 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.539675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33816 (local address 127.30.73.126:42951)
0811 07:08:41.540346 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.540351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.540373 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:08:41.540417 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.540421 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.540506 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.540630 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.542104 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.543329 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.544661 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.546012 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.546851 (+ 839us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.552023 (+ 5172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.552029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.552033 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.552071 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.555488 (+ 3417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.556444 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.556453 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.556460 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.556635 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.557279 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.557285 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.557289 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.557740 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.558116 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.558453 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.558728 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":324,"threads_started":1}
I20260811 07:08:41.562355 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.545272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60228)
0811 07:08:41.545512 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.545537 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:41.545664 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:41.546304 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:41.546312 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:41.546902 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:41.547197 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.547210 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.548293 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.548299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.549430 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.549447 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.550567 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.550574 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.550877 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.551614 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:41.551645 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:41.554802 (+ 3157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:41.558872 (+ 4070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.558879 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.558885 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.559623 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.560099 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.560105 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.560111 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.560285 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.560914 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:41.560919 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:41.561127 (+ 208us) client_negotiation.cc:769] Sending connection context
0811 07:08:41.561404 (+ 277us) client_negotiation.cc:240] Negotiation successful
0811 07:08:41.561758 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":26}
I20260811 07:08:41.563382 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.545744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60228 (local address 127.30.73.124:45919)
0811 07:08:41.545986 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.545995 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.546017 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:08:41.546080 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.546087 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.546169 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.546268 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.547382 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.548156 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.549602 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.550396 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.550545 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.555000 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.555008 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.555018 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.555051 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.558690 (+ 3639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.559737 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.559744 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.559747 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.559922 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.560411 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.560419 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.560423 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.560796 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.560935 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.562663 (+ 1728us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.562975 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":98}
I20260811 07:08:41.563992 25014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.545312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.125:40509 (local address 127.0.0.1:56108)
0811 07:08:41.545529 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.545549 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:41.545653 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:41.546680 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:41.546685 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:41.547185 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:41.547393 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.547402 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.549066 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.549072 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.550939 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.550952 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.552217 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.552223 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.552435 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.553207 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:41.553233 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:41.556350 (+ 3117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:41.561062 (+ 4712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.561066 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.561070 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.561640 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.562143 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.562149 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.562153 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.562335 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.563071 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:41.563077 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:41.563268 (+ 191us) client_negotiation.cc:769] Sending connection context
0811 07:08:41.563441 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 07:08:41.563747 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":20}
I20260811 07:08:41.564841 25017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.545718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56108 (local address 127.30.73.125:40509)
0811 07:08:41.546340 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.546347 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.546365 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:08:41.546419 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.546424 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.546506 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.546639 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.547605 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.548883 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.551104 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.551857 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.551982 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.556575 (+ 4593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.556581 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.556588 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.556634 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.560930 (+ 4296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.561785 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.561789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.561793 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.561985 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.562495 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.562499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.562502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.562842 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.562983 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.564328 (+ 1345us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.564524 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":505,"thread_start_us":382,"threads_started":1}
I20260811 07:08:41.566145 25009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:08:41.573355 24923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a: Bootstrap starting.
Aug 11 07:08:41 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432121, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.124@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
Aug 11 07:08:41 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.73.125@KRBTEST.COM
I20260811 07:08:41.578378 24923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:41.580193 24923 log.cc:824] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:41.583644 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.567088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60234 (local address 127.30.73.124:45919)
0811 07:08:41.567269 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.567276 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.567338 (+ 62us) server_negotiation.cc:407] Connection header received
0811 07:08:41.567560 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.567566 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.567658 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.567759 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.568958 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.570095 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.571828 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.572469 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.572603 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.577086 (+ 4483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.577093 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.577096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.577134 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.580326 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.581181 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.581188 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.581192 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.581346 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.581805 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.581811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.581843 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.582273 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.582474 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.582848 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.583276 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":195,"server-negotiator.queue_time_us":50}
I20260811 07:08:41.583693 25014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.567037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60234)
0811 07:08:41.567266 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.567289 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:41.567407 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:41.567977 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:41.567982 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:41.568554 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:41.568766 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.568778 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.570246 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.570255 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.571660 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.571679 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.572671 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.572679 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.572961 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.573646 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:41.573675 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:41.576861 (+ 3186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:41.580494 (+ 3633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.580499 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.580504 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.581048 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.581507 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.581511 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.581515 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.581664 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.582402 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:41.582407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:41.582590 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 07:08:41.582751 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 07:08:41.583157 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":22}
I20260811 07:08:41.584596 24923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a: No bootstrap required, opened a new log
I20260811 07:08:41.586534 25017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.561672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56124 (local address 127.30.73.125:40509)
0811 07:08:41.565149 (+ 3477us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.565155 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.565172 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:08:41.565220 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.565228 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.565304 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.565417 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.567526 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.568850 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.570380 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.571105 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.571231 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.578142 (+ 6911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.578150 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.578154 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.578203 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.582531 (+ 4328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.583522 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.583529 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.583535 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.583691 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.584176 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.584184 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.584190 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.584615 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.585945 (+ 1330us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.586075 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.586271 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3316,"thread_start_us":4326,"threads_started":1}
I20260811 07:08:41.591120 25009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c: Bootstrap starting.
I20260811 07:08:41.593428 31013 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:08:41.596249 25009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:41.597175 24923 raft_consensus.cc:348] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } }
I20260811 07:08:41.597703 24923 raft_consensus.cc:729] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 995e9e102f4d4776874050d86f059f1a, State: Initialized, Role: FOLLOWER
I20260811 07:08:41.598042 25009 log.cc:824] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:41.598361 24923 consensus_queue.cc:260] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } }
I20260811 07:08:41.596239 24811 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "87f844927c1240c1bcdeb716d141a1e1"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33816
I20260811 07:08:41.602659 25009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c: No bootstrap required, opened a new log
I20260811 07:08:41.602437 25022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.602918 25022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:41.604018 24923 sys_catalog.cc:564] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:41.615152 25009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } }
I20260811 07:08:41.615694 25009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ab9e15dba0b4d22a561137d7c31649c, State: Initialized, Role: FOLLOWER
I20260811 07:08:41.616432 25009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } }
W20260811 07:08:41.617542 25034 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:08:41.617682 25034 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:08:41.614699 24850 master_runner.cc:186] Error getting master registration for 127.30.73.126:42951: OK, instance_id { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" instance_seqno: 1786432120211825 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:08:41.627447 24850 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:08:41.628275 25038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.628760 25038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:41.630062 25009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:41.648180 24839 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } attempt: 5
I20260811 07:08:41.639886 24932 master_runner.cc:186] Error getting master registration for 127.30.73.126:42951: OK, instance_id { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" instance_seqno: 1786432120211825 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:08:41.656809 24932 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 07:08:41 dist-test-slave-69rg krb5kdc[24748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.73.126@KRBTEST.COM for kudu/127.30.73.124@KRBTEST.COM
W20260811 07:08:41.662036 25049 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:08:41.662182 25049 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:08:41.669420 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.649062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.73.124:45919 (local address 127.0.0.1:60240)
0811 07:08:41.649554 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 07:08:41.649578 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:08:41.649730 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:08:41.650943 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:08:41.650947 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:08:41.651540 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:08:41.651813 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.651828 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.653368 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.653374 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.655024 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:08:41.655042 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.656431 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.656440 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:08:41.656665 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.657488 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:08:41.657519 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:08:41.660682 (+ 3163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:08:41.665524 (+ 4842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.665531 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.665536 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.666140 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.666787 (+ 647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:08:41.666795 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:08:41.666799 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:08:41.667134 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:08:41.668249 (+ 1115us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:08:41.668255 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:08:41.668439 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 07:08:41.668608 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 07:08:41.668939 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330}
I20260811 07:08:41.670464 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.650008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60240 (local address 127.30.73.124:45919)
0811 07:08:41.650285 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.650291 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.650313 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:08:41.650387 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.650393 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.650547 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.650639 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.652024 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.653188 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.655244 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.655993 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.656120 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.660921 (+ 4801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.660929 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.660934 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.660978 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.665327 (+ 4349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.666335 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.666343 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.666347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.666622 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.667297 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.667303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.667308 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.667997 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.668172 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.669838 (+ 1666us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.670113 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260811 07:08:41.677604 24839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1: Bootstrap starting.
I20260811 07:08:41.682690 24839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1: Neither blocks nor log segments found. Creating new log.
I20260811 07:08:41.684288 24839 log.cc:824] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:08:41.694422 24839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1: No bootstrap required, opened a new log
I20260811 07:08:41.703142 24839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } }
I20260811 07:08:41.703593 24839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87f844927c1240c1bcdeb716d141a1e1, State: Initialized, Role: FOLLOWER
I20260811 07:08:41.704185 24839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } }
I20260811 07:08:41.705806 25052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.706642 25052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:41.706995 24839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:08:41.707065 24811 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 07:08:41.707290 24811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:41.711083 24811 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } }
I20260811 07:08:41.713789 24897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87f844927c1240c1bcdeb716d141a1e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "995e9e102f4d4776874050d86f059f1a"
I20260811 07:08:41.714421 24897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:41.718631 24897 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87f844927c1240c1bcdeb716d141a1e1 in term 1.
I20260811 07:08:41.719468 24782 leader_election.cc:302] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87f844927c1240c1bcdeb716d141a1e1, 995e9e102f4d4776874050d86f059f1a; no voters:
I20260811 07:08:41.721108 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87f844927c1240c1bcdeb716d141a1e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0ab9e15dba0b4d22a561137d7c31649c"
I20260811 07:08:41.721678 24981 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:08:41.725464 24981 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87f844927c1240c1bcdeb716d141a1e1 in term 1.
I20260811 07:08:41.726318 24811 leader_election.cc:288] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [CANDIDATE]: Term 1 election: Requested vote from peers 995e9e102f4d4776874050d86f059f1a (127.30.73.125:40509), 0ab9e15dba0b4d22a561137d7c31649c (127.30.73.124:45919)
W20260811 07:08:41.726557 24959 tablet.cc:2369] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:08:41.733799 25052 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:08:41.744856 25052 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [term 1 LEADER]: Becoming Leader. State: Replica: 87f844927c1240c1bcdeb716d141a1e1, State: Running, Role: LEADER
I20260811 07:08:41.746031 25052 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } }
I20260811 07:08:41.759694 25058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f844927c1240c1bcdeb716d141a1e1. Latest consensus state: current_term: 1 leader_uuid: "87f844927c1240c1bcdeb716d141a1e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.760339 25058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:41.776669 25066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260811 07:08:41.779779 24875 tablet.cc:2369] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:08:41.803582 25066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:08:41.810094 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.777591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60248 (local address 127.30.73.124:45919)
0811 07:08:41.777802 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.777811 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.786418 (+ 8607us) server_negotiation.cc:407] Connection header received
0811 07:08:41.786609 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.786615 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.786699 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.786797 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.792114 (+ 5317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.793170 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.795277 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.795976 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.796093 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.799647 (+ 3554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.799654 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.799659 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.799702 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.803329 (+ 3627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.806285 (+ 2956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.806292 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.806296 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.806460 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.807326 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.807331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.807334 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.807865 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.808258 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.809388 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.809662 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:08:41.815850 25075 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:08:41.837982 25017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.763205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56132 (local address 127.30.73.125:40509)
0811 07:08:41.763492 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.763502 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.774749 (+ 11247us) server_negotiation.cc:407] Connection header received
0811 07:08:41.776071 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.776079 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.776218 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.776312 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.784680 (+ 8368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.785933 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.791606 (+ 5673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.792288 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.792410 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.815820 (+ 23410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.815831 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.815837 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.815892 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.820109 (+ 4217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.834149 (+ 14040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.834157 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.834161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.834348 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.835132 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.835138 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.835141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.835594 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.835887 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.837219 (+ 1332us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.837494 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 07:08:41.846535 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:41.764539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33818 (local address 127.30.73.126:42951)
0811 07:08:41.764823 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:41.764833 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:41.776966 (+ 12133us) server_negotiation.cc:407] Connection header received
0811 07:08:41.779609 (+ 2643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:41.779614 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:41.779732 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:41.779838 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:41.788101 (+ 8263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.789209 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.793549 (+ 4340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:41.794314 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:41.794416 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:41.828599 (+ 34183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:08:41.828608 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:08:41.828615 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:08:41.828680 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:08:41.832857 (+ 4177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.836407 (+ 3550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.836414 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.836418 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.836576 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:08:41.838694 (+ 2118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:08:41.838700 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:08:41.838704 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:08:41.839113 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:08:41.839385 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:41.845882 (+ 6497us) server_negotiation.cc:299] Negotiation successful
0811 07:08:41.846177 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:08:41.866062 24897 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [term 1 FOLLOWER]: Refusing update from remote peer 87f844927c1240c1bcdeb716d141a1e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:08:41.867340 24981 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [term 1 FOLLOWER]: Refusing update from remote peer 87f844927c1240c1bcdeb716d141a1e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:08:41.871363 25052 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:08:41.872514 25052 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:08:41.896549 25038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f844927c1240c1bcdeb716d141a1e1. Latest consensus state: current_term: 1 leader_uuid: "87f844927c1240c1bcdeb716d141a1e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.896955 25038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:41.901132 25076 mvcc.cc:205] Tried to move back new op lower bound from 7317225971108286464 to 7317225970687447040. Current Snapshot: MvccSnapshot[applied={T|T < 7317225971108286464}]
I20260811 07:08:41.903664 25077 mvcc.cc:205] Tried to move back new op lower bound from 7317225971108286464 to 7317225970687447040. Current Snapshot: MvccSnapshot[applied={T|T < 7317225971108286464}]
I20260811 07:08:41.913412 25038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87f844927c1240c1bcdeb716d141a1e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.913704 25038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:41.913617 25052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87f844927c1240c1bcdeb716d141a1e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.914018 25052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:41.917038 25066 catalog_manager.cc:1347] Generated new cluster ID: 0c7041bc0fea438196cddf6dff3f7127
I20260811 07:08:41.917161 25066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:08:41.918403 25022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f844927c1240c1bcdeb716d141a1e1. Latest consensus state: current_term: 1 leader_uuid: "87f844927c1240c1bcdeb716d141a1e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.918745 25022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:41.921231 25058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87f844927c1240c1bcdeb716d141a1e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.921473 25058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:08:41.929965 25022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87f844927c1240c1bcdeb716d141a1e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f844927c1240c1bcdeb716d141a1e1" member_type: VOTER last_known_addr { host: "127.30.73.126" port: 42951 } } peers { permanent_uuid: "995e9e102f4d4776874050d86f059f1a" member_type: VOTER last_known_addr { host: "127.30.73.125" port: 40509 } } peers { permanent_uuid: "0ab9e15dba0b4d22a561137d7c31649c" member_type: VOTER last_known_addr { host: "127.30.73.124" port: 45919 } } }
I20260811 07:08:41.930227 25022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:08:41.930918 25078 mvcc.cc:205] Tried to move back new op lower bound from 7317225971108286464 to 7317225970687447040. Current Snapshot: MvccSnapshot[applied={T|T < 7317225971108286464 or (T in {7317225971108286464})}]
I20260811 07:08:41.946390 25066 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:08:41.948079 25066 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:08:41.980986 25066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87f844927c1240c1bcdeb716d141a1e1: Generated new TSK 0
I20260811 07:08:41.985526 25066 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:08:42.134104 25015 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.122646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33832 (local address 127.30.73.126:42951)
0811 07:08:42.122868 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.122875 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.131251 (+ 8376us) server_negotiation.cc:407] Connection header received
0811 07:08:42.131840 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.131846 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.131939 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.132016 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.133595 (+ 1579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33832: BlockingRecv error: recv got EOF from 127.0.0.1:33832 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260811 07:08:42.136881 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.125169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56136 (local address 127.30.73.125:40509)
0811 07:08:42.125418 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.125425 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.135188 (+ 9763us) server_negotiation.cc:407] Connection header received
0811 07:08:42.135457 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.135463 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.135556 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.135638 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.136582 (+ 944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56136: BlockingRecv error: recv got EOF from 127.0.0.1:56136 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260811 07:08:42.145512 25012 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.142991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60254 (local address 127.30.73.124:45919)
0811 07:08:42.143227 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.143234 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.143527 (+ 293us) server_negotiation.cc:407] Connection header received
0811 07:08:42.143808 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.143814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.143899 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.143981 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.145239 (+ 1258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60254: BlockingRecv error: recv got EOF from 127.0.0.1:60254 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 07:08:42.210407 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.196371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56140 (local address 127.30.73.125:40509)
0811 07:08:42.196608 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.196627 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.207744 (+ 11117us) server_negotiation.cc:407] Connection header received
0811 07:08:42.208401 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.208409 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.208559 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.208684 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.210092 (+ 1408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56140: BlockingRecv error: recv got EOF from 127.0.0.1:56140 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 07:08:42.261780 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.248011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56150 (local address 127.30.73.125:40509)
0811 07:08:42.248255 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.248263 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.259892 (+ 11629us) server_negotiation.cc:407] Connection header received
0811 07:08:42.260159 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.260167 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.260299 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.260434 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.261506 (+ 1072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56150: BlockingRecv error: recv got EOF from 127.0.0.1:56150 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260811 07:08:42.270402 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.268045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56166 (local address 127.30.73.125:40509)
0811 07:08:42.268290 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.268300 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.268859 (+ 559us) server_negotiation.cc:407] Connection header received
0811 07:08:42.269090 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.269103 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.269193 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.269311 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.270121 (+ 810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56166: BlockingRecv error: recv got EOF from 127.0.0.1:56166 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 07:08:42.279522 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.277466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56170 (local address 127.30.73.125:40509)
0811 07:08:42.277732 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.277739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.278009 (+ 270us) server_negotiation.cc:407] Connection header received
0811 07:08:42.278247 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.278252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.278336 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.278441 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.279270 (+ 829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56170: BlockingRecv error: recv got EOF from 127.0.0.1:56170 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
W20260811 07:08:42.293007 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.290816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56186 (local address 127.30.73.125:40509)
0811 07:08:42.291052 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.291061 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.291605 (+ 544us) server_negotiation.cc:407] Connection header received
0811 07:08:42.291832 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.291838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.291935 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.292046 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.292768 (+ 722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56186: BlockingRecv error: recv got EOF from 127.0.0.1:56186 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 07:08:42.314950 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.312588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56202 (local address 127.30.73.125:40509)
0811 07:08:42.312847 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.312856 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.313429 (+ 573us) server_negotiation.cc:407] Connection header received
0811 07:08:42.313659 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.313664 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.313755 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.313911 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.314707 (+ 796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56202: BlockingRecv error: recv got EOF from 127.0.0.1:56202 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 07:08:42.355219 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.352102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56208 (local address 127.30.73.125:40509)
0811 07:08:42.352352 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.352362 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.353547 (+ 1185us) server_negotiation.cc:407] Connection header received
0811 07:08:42.353862 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.353876 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.353960 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.354085 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.354902 (+ 817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56208: BlockingRecv error: recv got EOF from 127.0.0.1:56208 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 07:08:42.434327 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.431849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56224 (local address 127.30.73.125:40509)
0811 07:08:42.432120 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.432127 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.432584 (+ 457us) server_negotiation.cc:407] Connection header received
0811 07:08:42.432866 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.432871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.432952 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.433119 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.434097 (+ 978us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56224: BlockingRecv error: recv got EOF from 127.0.0.1:56224 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 07:08:42.568133 25017 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:08:42.566156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56240 (local address 127.30.73.125:40509)
0811 07:08:42.566408 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.566416 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.566662 (+ 246us) server_negotiation.cc:407] Connection header received
0811 07:08:42.566907 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.566912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.566987 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.567100 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:08:42.567911 (+ 811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56240: BlockingRecv error: recv got EOF from 127.0.0.1:56240 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 07:08:42.619912 25034 catalog_manager.cc:1259] Loaded cluster ID: 0c7041bc0fea438196cddf6dff3f7127
I20260811 07:08:42.620060 25034 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a: loading cluster ID for follower catalog manager: success
I20260811 07:08:42.622630 25034 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a: acquiring CA information for follower catalog manager: success
I20260811 07:08:42.624445 25034 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 995e9e102f4d4776874050d86f059f1a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:08:42.665061 25049 catalog_manager.cc:1259] Loaded cluster ID: 0c7041bc0fea438196cddf6dff3f7127
I20260811 07:08:42.665239 25049 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c: loading cluster ID for follower catalog manager: success
I20260811 07:08:42.668840 25049 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c: acquiring CA information for follower catalog manager: success
I20260811 07:08:42.671382 25049 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0ab9e15dba0b4d22a561137d7c31649c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:08:42.835443 25017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:42.828811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56252 (local address 127.30.73.125:40509)
0811 07:08:42.829028 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.829034 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.829266 (+ 232us) server_negotiation.cc:407] Connection header received
0811 07:08:42.829467 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.829472 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.829776 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.829921 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:42.830432 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.831248 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.832745 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.833234 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.833374 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:42.833991 (+ 617us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:42.834752 (+ 761us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:42.834938 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:42.835007 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 07:08:42.835116 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:08:42.850368 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:42.843128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60258 (local address 127.30.73.124:45919)
0811 07:08:42.843755 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.843761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.843897 (+ 136us) server_negotiation.cc:407] Connection header received
0811 07:08:42.844115 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.844121 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.844347 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.844547 (+ 200us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:42.845044 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.845967 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.847490 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.847906 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.848014 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:42.848611 (+ 597us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:42.849457 (+ 846us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:42.849580 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:42.849750 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 07:08:42.849888 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":334,"threads_started":1}
I20260811 07:08:42.866048 25017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:42.857824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56256 (local address 127.30.73.125:40509)
0811 07:08:42.858154 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.858164 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.858525 (+ 361us) server_negotiation.cc:407] Connection header received
0811 07:08:42.858912 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.858923 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.859068 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.859187 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:42.860239 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.861545 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.863778 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.864260 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.864427 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:42.865107 (+ 680us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:42.865268 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:42.865383 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:42.865525 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 07:08:42.865622 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 07:08:42.867436 25168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:42.857653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33842 (local address 127.30.73.126:42951)
0811 07:08:42.858724 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.858732 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.859251 (+ 519us) server_negotiation.cc:407] Connection header received
0811 07:08:42.859431 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.859439 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.859718 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.859934 (+ 216us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:42.860984 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.862336 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.864384 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.865046 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.865182 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:42.865955 (+ 773us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:42.866601 (+ 646us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:42.866752 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:42.866899 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 07:08:42.867012 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":900,"thread_start_us":743,"threads_started":1}
I20260811 07:08:42.867952 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:08:42.859401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60262 (local address 127.30.73.124:45919)
0811 07:08:42.860003 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0811 07:08:42.860011 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:08:42.861006 (+ 995us) server_negotiation.cc:407] Connection header received
0811 07:08:42.861221 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:08:42.861228 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:08:42.861318 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:08:42.861411 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:08:42.862227 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.863413 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.865379 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:08:42.866148 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:08:42.866255 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:08:42.866997 (+ 742us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:08:42.867148 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:08:42.867217 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:08:42.867484 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 07:08:42.867593 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470}
I20260811 07:08:42.878754 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24762
I20260811 07:08:42.880093 24834 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:43.008412 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 24762
W20260811 07:08:43.042353 24955 connection.cc:535] server connection from 127.0.0.1:60240 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:08:43.043228 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24850
I20260811 07:08:43.044814 24918 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:43.186687 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 24850
I20260811 07:08:43.218853 31013 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu pid 24932
I20260811 07:08:43.220366 25003 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 07:08:43.351147 31013 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgm9MY0/build/asan/bin/kudu with pid 24932
2026-08-11T07:08:43Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5258 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10891 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (401119 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST